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series.  The  form  of  the  models  is  a  Kalman  filter/prediclor.  Once  a  model  has  been  determined,  predictions 
can  be  made  based  on  this  model  and  past  data.  Since  the  underlying  dynamics  of  the  time  series  may  change 
in  an  unpredictable  manner,  provision  has  been  made  to  estimate  the  parameters  of  the  model  recursively. 
This  allows  one,  for  example,  to  follow  the  effects  of  policy  changes  (fast  rate  of  change  of  parameters)  or 
more  long-term  changes  which  cannot  be  explicitly  modeled. 

The  technical  effort  was  divided  into  three  major  phases: 

Phase  I:  PJM  payoff  matrix-  column  mean  data  over  a  five-year  period,  beginning  in  January  1973. 
were  collected  and  statistically  analyzed.  A  total  of  50  categories  were  selected  to  span  the  dimensions  of  sex. 
skill  score  and  job  area  (Administrative,  electronic.  General  and  Mechanical).  A  frequency  analysis  showed 
that  various  series  contained  significantly  different  spectra,  with  peaks  at  (t/year,  4/year,  and  3/year.  The 
semiannual  component  is  probably  tied  to  the  academic  year.  A  correlation  analysis  showed  that  most  female 
high  skill  series  move  together.  Female  low  skill  series  also  showed  the  same  trend,  though  not  as  marked. 
Male  series  were,  in  general,  correlated,  but  were  less  so  than  the  female  series.  Male  and  female  series  were 
essentially  uncorrelated.  A  set  of  state  space  models  was  developed  for  the  individual  time  series.  A  set  of 
Kalman  filter/predictors  was  then  generated,  based  on  the  state  space  models. 

Phase  II:  An  adaptive  Kalman  filter  methodology  was  developed  for  the  PJM  data.  The  adaptive  filter 
was  an  approximate  maximum  likelihood  estimator  for  the  Kalman  filter/predirtor  parameters.  Two 
adaptation  parameters  were  used:  (a)  an  age  weighting  parameter  to  discount  old  data,  and  (b)  an  adaptation 
time  constant  to  control  the  rate  of  change  of  the  parameter  estimates.  The  adaptation  parameters  were 
themselves  varied  recursively  to  minimize  the  mean-squared  prediction  errors.  The  dynamic  coefficients  of  a 
linear  Kalman  filter/predirtor  were  estimated  causally  from  the  data,  along  with  the  usual  Kalman  filter  state 
estimates,  and  shown  to  give  better  performance  than  the  non-adaptive  (stationary)  Kalman  filter/predirtor. 

Phase  III:  An  extended  Kalman  filter  was  developed  for  use  on  the  PJM  data.  This  filter  was  intended 
for  use  in  estimating  the  parameters  of  the  Kalman  filter:  i.e..  the  problem  studied  was  that  studied  in  Phase 
H.  The  extended  filter  did  not  appear  as  suitable  for  use  on  PJM  data  due  to:  (a)  increased  complexity,  (b)  its 
generally  poor  convergence  properties,  and  (e)  its  generally  decreased  accuracy. 
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1.  INTRODUCTION 


The  computer-based  Air  Force  Advanced  Personnel  Data  System  (APDS) 
and  the  Procurement  Management  Information  System  (PROMTS)  utilize  several 
advanced  concepts  from  the  field  of  statistics  and  operations  research 
(Ward,  Haney,  Hendrix  and  Pina,  1 9 7 B > .  In  particular,  the  Person-Job 
Match  (PJM)  system  is  based  on  the  development  of  a  payoff  matrix  the 

( i , j ) ^  element  of  which  represents  the  predicted  payoff  to  the  Air  Force 

of  assigning  the  j^1  job  to  the  i^1  individual.  The  purpose  of  the  PJM 
system  is  to  maximize  the  total  payoff  to  the  Air  Force  over  all  tasks 
and  individuals.  Since  the  PJM  system  is  sequential,  a  job  has  to  be 
assigned  to  a  person  at  the  current  time  without  full  knowledge  of  the 
availability  of  persons  and  their  job  skills  in  the  future.  For  example, 
if  the  planning  horizon  is  9  months,  the  optimal  allocation  of  jobs  at 
the  current  time  would  depend  on  the  statistics  of  the  available  pool  of 
applicants  o%rer  the  next  9  months.  In  this  sense,  the  PJM  problem  is  one 
of  stochastic  optimization  or  of  decision  under  uncertainty.  The  method 
by  which  this  problem  is  being  solved  is  discussed  at  greater  length  in 
Chapter  2.  For  the  purposes  of  this  discussion,  it  will  suffice  to  state 
that  the  present  algorithm  relies  on  the  column  mean  (average  over  task) 
of  the  payoff  matrix.  Due  to  the  large  number  of  transactions  that  occur 
in  the  system,  it  is  not  feasible  to  maintain  current  column  means.  The 
quantities  used  must  thus  be  estimates  of  the  current  means  given  histori¬ 
cal  data.  It  is  this  problem  of  payoff  mean  time  series  estimation  that 
this  report  will  address. 

Over  the  last  30  years,  starting  with  the  groundbreaking  work  of 
Bellman  (1957)  on  Dynamic  Programming  and  that  of  Kalman  (1960)  on  pre¬ 
diction,  a  large  amount  of  research  has  been  done  in  the  field  of  sto¬ 
chastic  optimization  and  control.  The  state  space  representation  of 
dynamic  and  multistage  systems  has  played  a  key  role  in  the  solution  of 
these  problems.  The  earliest  applications  of  these  techniques  .toojc  place  . 
in  the  aerospace  field  where  the  state  space  models  were  easy  to  derive 
from  known  physical  laws.  The  applications  in  the  management  and  socio¬ 
economic  areas  have  been  slow  to  develop  due  to  the  difficulty  of  deriving 
state  space  models  for  such  systems.  However,  recent  work  in  the  area 
of  system  identification  (e.g.,  IEEE.,  1974;  Mehra  and  Lainiotis,  1976) 
has  provided  several  methods  for  deriving  state  space  models  empirically 
from  input-output  data.  This  research  lias  studied  the  application  of  the 
concepts  for  solving  the  PJM  problem. 

The  specific  method  of  approach  consisted  of  four  phases  which  pro¬ 
gressed  from  the  initial  development  of  a  linear  Kalman  filter/predictor 
(Phase  I)  for  job  column  payoff  means  to  its  enhancement  by  using  adaptive 
(Phase  II)  and  extended  (Thase  III)  Kalman  filtering  techniques,  followed 
by  a  more  general  study  of  the  PJM  system  for  further  improvements  and 
applications  of  the  state  space  techniques  (Phase  IV).  Since  the  structure 
of  the  state  space  model  and  and  parameter  values  cannot  be  inferred 
directly  from  theoretical  or  first-principle  considerations .  techniques 
of  system  identification,  parameter  estimation  and  time  se' .  ;  analysis 

(IF.EE,  1974;  Mehra  and  Lainiotis,  1976)  have  been  used  for  b>  i.  iing 


predictive  models.  Scientific  Systems,  Inc.  has  utilized  already- 
developed  software  for  state  space  model  structure  determination  using 
canonical  correlations  and  for  parameter  estimation  using  the  maximum 
likelihood  method.  A  brief  description  of  these  programs  is  contained 
in  Chapter  4.  The  state  space  forecasting  program  described  in  Chapter  4 
also  performs  automatic  detrending  and  deseasonalizing  to  convert  non¬ 
stationary  time  series  into  stationary  time  series. 

The  models  for  the  Kalman  filter/predictor  are  based  on  historical 
data  and  a  priori  knowledge.  Since  the  structure  of  the  real  system  may 
change  over  time,  it  is  important  to  detect  these  changes  and  adapt  the 
Kalman  filter  accordingly.  The  exact  form  of  the  adaptive  filter  depends 
upon  the  expected  structural  changes,  but  the  techniques  of  model  valida¬ 
tion  and  hypothesis  testing  (Chapter  4)  can  be  used  to  detect  changes  in 
system  structure,  states  and  parameters.  These  techniques  have  been  ap¬ 
plied  to  the  PJM  time  series. 

Extended  Kalman  filters  can  provide  improvements  to  the  basic  Kalman 
filter  to  account  for  non-Gaussian  statistics,  nonlinearities  in  the  state 
and  measurement  equations  and  errors  in  independent  variables  (Mehra,  1976), 
which  may  be  present  in  the  PJM  system.  They  can  also  provide  an  alternate 
adaptive  filter  methodology. 

Application  of  stochastic  control  techniques  for  optimal  assignment 
under  uncertainty  (e.g.,  to  take  into  account  confidence  levels  on  fore¬ 
casts  and  to  use  second  order  statistics  of  the  payoff  series)  is  one 
method  of  solving  the  PJM  assignment  problem. 

This  report  is  organized  as  follows.  In  Chapter  2,  a  basic  descrip¬ 
tion  of  the  PJM  system  is  given,  and  the  problem  of  payoff  matrix  column 
mean  prediction  is  discussed.  Chapter  3  presents  a  statistical  analysis 
of  payoff  data  spanning  a  5-vear  period,  from  January  1973.  The  notions 
of  state  space  modeling  and  prediction  for  time  series  data  are  introduced 
in  Chapter  4,  including  the  formulation  of  the  prediction  problem  in  a 
Kalman  filtering  regime.  Chapter  5  presents  an  efficient  technique  for 
model  structure  determination,  based  on  recent  results  in  stochastic 
realization  theory.  The  methods  in  Chapter  5  are  limited  to  stationary 
■-processes.  -  State-  space  models  for  selected  PJM  time  series  are  given  in 
Chapter  6;  predictions  based  on  these  models  are  found  and  compared  with 
persistence  predictions.  Analysis  of  PJM  data  has  revealed  significant 
nonstationarities  in  the  parameters  of  the  linear  models.  The  nonstation¬ 
ary  problem  is  attacked  by  using  a  parameter-adaptive  Kalman  filter  pre¬ 
dictor,  developed  in  Chapter  7.  This  adaptive  algorithm  is  an  approximate 
maximum  likelihood  estimator.  An  alternative  approach  is  to  use  an  Ex¬ 
tended  Kalman  filter  for  parameter  adaptation.  This  method  is  discussed 
in  Appendix  C.  The  adaptive  algorithms  are  applied  to  the  problem  of  PJM 
time  series  prediction  in  Chapter  8  and  to  prediction  for  series  with 
known  mathematical  structure  in  Appendix  D.  Numerical  comparisons  indi¬ 
cate  that  improvements  can  be  obtained  over  the  use  of  stationary  time 
series  models.  Conclusions  and  recommendations  for  further  work  are 
given  in  Chapter  9. 
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2.  PJM  SYSTEM  DESCRIPTION 


2. 1  Problem  Statement 

The  assignment  procedures  in  the  Air  Force  Procurement  Management 
Information  System  (PROMIS)  are  well  described  in  Ward  et  al.  (1977). 

The  critical  information  for  person-job  matching  is  the  Predicted  Payoff 
Array,  which  contains  payoff  values  estimated  from  a  mathematical  model 
using  person-job  information  and  the  subjective  judgement  of  Air  Force 
managers  (Ward,  1977).  The  assignment  problem  may  be  solved  using  optimal 
algorithms  for  batch  assignment  or  near-optimum  algorithms  for  sequential- 
constrained-choice  assignment.  It  is  more  useful  in  practice  to  develop 
an  allocation  array  using  decision  indices  (Ward,  1959)  since  alternative 
assignments  that  are  nearly  optimal  can  also  be  indicated. 

The  PJM  problem  has  mostly  been  formulated  in  the  operations  research 
literature  as  a  static  deterministic  assignment  problem.  In  practice, 
however,  it  is  a  stochastic  dynamic  problem  in  which  decisions  have  to 
be  made  sequentially  over  time  based  on  the  best  current  information  to 
optimize  the  payoff  over  a  certain  period  of  time.  In  this  sense,  the 
PJM  problem  is  akin  to  the  Secretary  Problem  (Bellman,  1957),  but  much 
larger  in  size  and  scope.  Bayesian  statistical  decision  thoery  and  sto¬ 
chastic  control  provide  suitable  mathematical  frameworks  for  such  problems. 
The  most  elegant  results  in  stochastic  control  and  Bayesian  decision  ana¬ 
lysis  are  available  for  the  so-called  Linear-Quadratic-Guassian  (LQG) 
problem,  involving  linear  dynamics,  Gaussian  statistics  and  quadratic  cost 
or  payoff  function  (IEEE,  1971).  The  optimal  decision  law  is  a  linear 
function  of  the  optimal  state  estimate  and  the  control  law  does  not  depend 
on  the  second  and  higher  order  moments  of  the  state  estimates  (certainty 
equivalence  principle).  The  optimal  state  estimate  is  given  by  a  linear 
Kalman  filter  (Kalman,  1960). 

The  PJM  problem  does  not  satisfy  all  the  assumptions  of  the  LQG  for¬ 
mulation,  but  its  optimal  solution  in  a  constrained  sequential  mode  would 
involve  forecasting  of  job  skill  levels  over  the  planning  horizon.  If  we 

denote  by  r.  .  (t)  the  payoff  (or  reward)  at  time  t  of  matching  individual  i 
1  >  J 

to  job  j,  then  the  variation  of  r  .(t)  over  the  individuals  (i.e.,  i's) 

i*  1  _ 

may  be  described  by  a  probability  distribution  function  P  (r) .  In 
_  j  >  t 

other  words,  P  (r)  denotes  the  fraction  of  applicants  with  payoff  less 
J » *■_ 

than  or  equal  to  r  for  job  A  and  time  t.  If  the  pool  of  applicants  is  very 

large,  P,  (r)  would  tend  to  be  a  continuous  function  of  r  and  can  be 

j  >  t  _  _  _ 

differentiated  to  obtain  a  probability  density  function  p  (r) = dP  (r)/dr. 

J  >  t  J » c 

In  a  sequential  decision  process,  the  optimal  allocation  of  individuals 
to  jobs  would  be  done  in  such  a  way  as  to  maximize  the  expected  payoff, 

EP,  with  respect  to  all  feasible  feedback  assignment  rules  {a  , (r. (1),..., 
r(t))}  where  ^ 


EP(a) 


T 

l 

t=l  j€J  iei 


I  I 


E{r^j (t) 


ai,j(rj(1) 


.,rj(t))} 
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E{*}  denotes  expectation  with  respect  to  P.  (r);  a.  ,  (r  .  (1) , . . . ,r  .  (t))  is 

J>t  1 » J  J  J 

a  binary  valued  function  (1  or  0)  specifying  an  assignment  at  time  t  of 
individual  i  to  job  j  based  on  the  observed  payoffs  {r^ (1) , . . . ,r^ (t))} .* 

In  practice,  this  decision  function  is  too  complex  to  implement,  so  that 
certain  statistics  of  the  observed  payoffs  will  be  used,  e.g.,  the  mean 


value  m j  ( t- 1 )  =* 


t-1 

l 


T  =  1 


r.(x)  and  r.(t)  may  be  used,**  as  is  currently 


being  done  in  the  APDS-PROMIS  system.  Another  choice  would  be 

(m^ (t-1) (t-1) (t) }  where  the  assignment  also  takes  into  account  the 

standard  deviation,  & ^ ( t— 1 )  around  the  mean  Su(t-l).  Irrespective  of  how 


the  decision  function  is  defined,  the  optimal  assignment  still  involves 
maximization  of  R  with  respect  to  assignment  rules  for  future  time  periods. 
The  exact  formulation  of  this  problem  requires  use  of  dynamic  programming 
or  backward  induction  (Bellman,  1957),  which  though  useful  from  a  concep¬ 
tual  point  of  view,  is  computationally  impractical  with  current  state  of 
the  art.  A  good  suboptimal  procedure  at  time  t  is  to  forecast  the  values 
of  the  future  mean  payoffs,  namely,  m . (t+1 ) , . . . ,m . (T)  and  to  solve  a  de¬ 


terministic  assignment  problem  assuming  certainty  equivalence,  namely, 
the  forecast  mean  values  are  the  actual  mean  values.  If  the  decision  rule 
also  includes  the  standard  deviation  3^(t),  then  these  deviations  may  also 

be  forecast  and  used  for  assignment.  All  the  forecasts  would  be  updated 
with  each  new  applicant,  using  a  recursive  filter/predictor.  The  details 
of  this  procedure  are  discussed  in  the  next  chapter. 


2.2  Problem  Formulation 

In  the  previous  section,  it  was  shown  that  a  solution  of  the  stochas¬ 
tic  multistage  PJ>1  problem  requires  forecasting  of  future  mean  payoffs 
over  the  planning  horizon  (9  months  in  PROMIS).  Since  historical  data 
on  the  mean  payoffs  are  available,  statistical  model-building  methods 
using  state  space  or  time  series  methods  can  be  used  for  forecasting. 

The  advantages  of  using  state  space  methods  are  that  multiple  time  series 
can  be  handled  in  essentially  the  same  way  as  single  time  series,  and 
control  theory  methods  can  be  used  for  decision  analysis.  In  addition, 
once  a  state  vector  model  has  been  identified,  Kalman  filtering  techniques 
can  be  used  for  recursive  forecasting.  The  confidence  intervals  for  fore¬ 
casts  are  also  obtained  directly  from  the  covariance  calculations  which 
are  an  integral  part  of  the  Kalman  filter. 

The  basic  payoff  model  for  PJM  at  time  of  contract  start  was: 


Y  = 


Vo 


+  b3Y3b11Yu  +  b12Y12 


+  b13Y]3  +  b2Y2  +  b3V3 


where 


Y  =  payoff  value  of  a  particular  person  assigned  to  a 
particular  job; 


*If  decision  indices  are  used, 


i,J 


**A  hat  over  a  quantity  denotes  its 


will  be  a  continuous  variable. 


estimate. 


9 


Yq  =  constant  fill  component,  which  is  given  to  eligible 
person-job  combinations  so  that  each  possible  clas¬ 
sification  is  assigned  a  positive  payoff; 

Y.„  =  indicator  of  skill  area  preference  (Mech,  Admin,  Gen, 
or  Elect); 

^11  =  aPtitude"difficulty  component,  which  is  a  composite 
function  of  applicant  aptitude  and  job  difficulty; 

=  technical  school  success  component,  which  is  a  pre¬ 
diction  of  final  technical  school  grades  based  on  a 
regression  of  final  grades  of  previous  graduates  onto 
their  aptitude  test  scores,  high  school  graduation 
status  and  high  school  courses  taken; 

Y2  =  variable  fill  component,  which  is  a  function  of  time 
left  until  a  particular  enlistment  date  and  of  the 
proportion  of  a  specific  job  quota  for  that  date 
which  has  been  filled.  Typically,  Y2  is  increased 
as  the  deadline  approaches; 

Y^  “  minority/non-minority  component,  which  is  a  function 
of  percent  minority/non-minority  representation  on 
a  given  job.  Y^  increases  for  jobs  with  lower  than 
average  representation. 

The  weights  bQ,  b^,...  control  the  priorities  of  the  six  components 

and  are  specified  by  managers  and  policy  makers.  The  coefficients  are 
adjusted  so  that  the  maximum  payoff  is  1000. 

Given  a  set  of  payoffs  {Y*d;  i=l,...,m;  j  =  l,...,n}  for  m  people 
and  n  jobs,  the  payoff  matrix  is 

Ty11  Y12  .  Yln“l 


and  the  column  means  are 

Y^  =  —  l  Y1^ 
m  i=l 


% 


The  data  available  for  this  study  included  column  means  over  a  5-year 
period  (1973  -  1977)  for  the  total  payoff  and  for  the  components  Y^  and 

Y^2*  In  addition,  total  number  and  eligible  number  of  applicants  data 

were  supplied.  Data  for  a  total  of  320  job  categories  (CAFSC)  were  supplied. 
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The  accuracy  of  predicting  column  means  is  of  particular  importance 
for  optimally  assigning  applicants  in  a  sequential  procedure  such  as  PJM. 

No  accurate  dynamical  models  for  this  set  cf  time  series,  based  on  economic 
modeling,  presently  exist,  nor  are  they  likely  to  be  developed.  The  prob¬ 
lem  is  compounded  by  high  month-to-month  variation  which  sometimes  causes 
certain  series  to  look  like  a  white  noise  (i.e. ,  completely  unpredictable) 
process.  However,  the  times  at  which  policy  changes  which  might  affect 
the  nature  of  the  time  series  go  into  effect  will  be  known.  This  in¬ 
formation  can  be  used  to  look  for  trends  in  the  data  at  specific  times. 
Thus,  the  prior  information  relating  to  possible  structural  properties  of 
the  PJM  column  means  is  minimal. 

The  best  approach  to  the  problem  at  present  is  to  utilize  empirical 
techniques  based  on  stochastic  realization  theory,  which  are  important 
generalizations  of  the  well-known  techniques  of  regression  analysis. 

The  specific  problem  addressed  in  this  report  is  development  of  a 
systematic  methodology  for  time  series  prediction  which  will  be  applicable 
to  PJM  time  series  data.  The  techniques  developed  are  quite  general  in 
nature,  but  will  be  demonstrated  to  possess  merit  for  the  specific  prob¬ 
lem  studied.  That  is,  they  are  demonstrated  to  offer  improvements  over 
traditional  (stationary)  time  series  analysis  techniques  when  used  to 
predict  payoff  column  means. 


3.  PAYOFF  DATA  ANALYSIS 


3. 1  Data  Used  in  the  Study 

The  basic  data  sets  used  in  this  study  consisted  of  two  sets  of  time 
series.  Both  sets  consisted  of  monthly  averages  or  totals  broken  down  by 
job  category,  Control  Air  Force  Specialty  Code  (CAFSC),  and  spanned  5  years 
beginning  with  January  1973.  There  were  thus  60  data  points  in  each  series 
analyzed.  The  first  data  set  used  consisted  of  monthly  column  means  of 
the  payoff  data.  The  second  data  set  consisted  of  the  monthly  means  of 
two  components  that  are  used  in  computing  the  total  payoff  (known  as  Y^ 

and  Y^)  and  the  monthly  totals  for  eligible  individuals  and  total  in¬ 
dividuals  for  each  category.  These  last  two  quantities  modulate  the 
number  of  applicants  for  the  various  job  categories  and  so  may  be  seen 
to  affect  the  variable  fill  component  used  in  the  payoffs. 

Both  data  sets  display  much  the  same  basic  character.  For  this  rea¬ 
son,  this  section  and  those  that  follow  will  emphasize  the  data  set  con¬ 
sisting  of  only  monthly  payoffs.  Also,  since  the  data  set  consists  of 
320  categories,  only  a  representative  sample  of  job  categories  was  selected 
to  span  the  various  categories  in  their  various  dimensions  of  sex,  skill 
score,  and  job  area  (Administrative,  Electronic,  general  and  Mechanical) 

A  total  of  50  payoff  series  were  analyzed  to  determine  their  basic 
statistical  behavior.  These  series  are  listed  in  Table  3.1. 

3. 2  Preliminary  Discussion  of  Basic  Time  Series  Behavior 

It  is  often  desirable  to  examine  plots  of  the  basic  data  to  discover 
any  underlying  trends,  similarities  between  series,  etc.  that  may  be  tied 
to  an  understood  phenomenon.  A  set  of  plots  of  the  raw  series,  their  3- 
month  moving  averages  and  12-month  moving  averages  for  a  set  of  repre¬ 
sentative  series  are  given  in  Appendix  A,  Figures  A.1-A.45.  As  may  be 
seen,  the  series  exhibit  a  variety  of  behaviors. 

The  E80F  class  data  appear  very  noisy,  indicating  that  prediction 
will  be  relatively  difficult.  The  remaining  E80F  class  data  were  smoother, 
with  a  single  peak  near  December  1975.  The  E70F  data  are  relatively  smooth 
and  show  two  peaks — one  near  December  1974  and  one  near  December  1976. 

The  E60F  data  match  E70F  closely,  and  E50F  also  looks  similar  to  the  E70F 
class.  G60F  data  do  not  exhibit  the  peak  near  December  1976.  M50F 
data  are  doubly  peaked  with  the  first  peak  somewhat  lower  and  occurring 
earlier.  The  male  series  are,  in  general,  smoother  than  the  correspond¬ 
ing  female  series.  All  series  should  probably  be  regarded  as  nonstationary 
due  to  their  lack  of  a  long-term  mean.  Two  general  trends  appear  that 
are  not  well  understood  in  terms  of  a  causal  event  or  policy  change.  The 
first  trend  is  the  rapid  increase  in  the  payoff  beginning  in  January  1976. 
The  second  is  the  leveling  off  and  falling  of  the  payoff  beginning  in  1977. 
The  3-month  averages  also  show  the  expected  local  peak  of  payoff  in  the 
summer  months.  The  anticipated  midwinter  peak  is  often  absent.  These 
peaks  have  been  historically  associated  with  an  increase  in  enlistments 
at  the  end  of  the  first  and  second  terms  of  the  academic  year. 


For  the  remaining  classes,  G50F,  G40F  and  A40F  cluster  and  exhibit 
a  rise  in  1974,  wide  variation  during  1975  and  1976,  and  a  fall  during 
1977.  Classes  A50F  and  M40F  exhibit  unique  shapes.  These  data  suggest 
that  only  a  few  significantly  different  time  series  models  may  possibly 
represent  most  of  the  time  series  data. 

Because  of  the  fact  that  it  is  expected  that  cyclical  variations 
will  occur  in  the  data  due  to  academic  year  end,  etc.,  it  is  also  of  in¬ 
terest  to  investigate  the  structure  of  the  series.  If  this  is  done,  a 
variety  of  behaviors  is  observed.  A  sample  of  these  behaviors  is  given 
in  Appendix  A,  Figures  A. 46 -A. 51.  The  series  F30430  displays  a  fre¬ 
quency  peak  corresponding  to  a  component  with  a  4-month  period.  F43130 
shows  a  peak  with  subannual  frequency,  but  also  appreciable  components 
at  semiannual  and  quarterly  periods.  Similar  behavior  occurs  in  F27131 
and  F42333,  but  with  diminished  higher  frequencies.  In  F20430,  the 
higher  frequencies  are  almost  gone,  while  M23123  shows  hardly  any  higher 
frequencies.  The  semiannual  component  is  probably  tied  to  the  academic 
year.  The  cause  of  the  higher  frequencies  is  unknown,  and  the  lower 
frequencies  are  probably  the  result  of  policy  changes. 

Due  to  the  similarity  in  shapes  between  some  of  the  time  series, 
it  is  of  interest  to  investigate  the  interclass  correlation  functions. 

These  correlation  functions  are  given  for  both  the  raw  series  and  the 
movement  (first  difference)  of  the  series  in  Tables  1  and  2  (Appendix  A), 
respectively.  Examining  these  tables,  it  is  possible  to  make  several 
observations:  certain  groups  such  as  the  E80  female  jobs  (variables  1 
to  4)  are  highly  correlated  with  themselves  but  not  with  most  oth-r  jobs. 
The  only  significant  correlation  is  a  mild  one  with  the  female  E70  job 
46330  (variable  11).  It  is  interesting  to  note  that  the  E80F  jobs  do 
not  show  significant  correlation  with  the  E80M  jobs.  This  may  indicate 
that  the  variable  fill  component  may  dominate  the  payoff  for  certain 
groups  since  all  the  E80F  jobs  are  competing  for  the  same  small  pool  of 
recruits.  A  similar  behavior  is  observed  for  the  A80M  jobs  (variables 
30  and  31). 

Interpretation  of  the  correlation  matrix  of  the  series  movement  is 
that  most  female  high  skill  series  move  only  in  unison  with  their  group. 
That  is,  the  A80F  jobs  will  move  as  a  group  but  are  not  strongly  correlated 
with  members  of  other  groups.  The  low  skill  female  series  show  a  greater 
tendency  to  move  in  a  correlated  fashion  with  members  of  other  female 
low  skill  groups.  It  is  interesting  to  note  that  the  movement  of  the 
female  series  is  not  significantly  correlated  with  the  movement  of  the 
male  series.  The  male  series  show  a  higher  tendency  to  be  correlated 
with  each  other  than  do  the  female  series. 

This  completes  the  basic  time  series  analysis  of  the  raw  data. 

Because  of  the  nonstationary  behavior  of  the  series,  statistics  such  as 
means,  variance,  kurtosis,  etc.  have  little  or  no  applicability  and  will 
not  be  presented. 
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Table  3. 1 


Series  Analyzed  in  Data  Set  #1 


CAFSC 

Skill  Level 

Series  Name  Used 
in  this  Report 

30230 

E80 

X30230 

30331 

E80 

X30331 

30333 

E80 

X30333 

30430 

E80 

X30430 

67231 

A80 

X67231 

67232 

A80 

X67232 

20230 

G80 

X20230 

20530 

G80 

X20530 

20830 

G80 

X20830 

25130 

G80 

X25130 

46330 

E70 

X46330 

46230 

E60 

X46230 

20430 

G60 

X20430 

54130 

E50 

X54130 

54230 

E50 

X54230 

54231 

E50 

X54231 

54232 

E50 

X54232 

54530 

E50 

X54530 

99000 

E50 

TSK295  -  Female,  TSK296  -  Male 

43130 

E50 

X43130 

42732 

G50 

X42732 

99000 

A50 

TSK287  -  Female,  TSK288  -  Male 

23132 

G40 

X23132 

27131 

A40 

X27131 

42333 

M50 

X42333 

;nif  les 

that  male  series  are  prefixed  bj 

;  M,  female  series  by  F 
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4.  STATE  SPACE  MODELING  AND  PREDICTION  FOR  TIME  SERIES  DATA 


4. I  Introduction 

In  Chapter  2,  the  payoff  r^(t)  for  job  j  was  defined  as  a  stochastic 

process  in  the  sense  that  it  is  a  function  of  time  t  and  of  a  random 
variable  s  (e.g.,  skill)  which  varies  over  the  population  of  applicants.* 
The  probability  distribution  of  r^(t)  was  denoted  by  P^(r(t))  where 

P.  ( t )  -  Probtr  (t)  ^  r}  (4.1) 

J  * c  J 


The  mean  payoff  m  (t)  over  a  given  population  of  applicants  is. 


therefore,  defined  as 


j 


m  (t)  =  /  r  dP  (r)  *  E{r  (t)} 

J  C  J  >  Z  J 

Sj 


(4.2) 


where  S^  denotes  the  set  of  all  possible  payoffs  for  job  j.  For  a  sequential- 

constrained  solution  of  the  PJM  problem,  one  is  interested  in  the  time- 

evolution  of  the  probability  distribution  function  P  (r)  or,  more  modestly, 

J  »  t 

of  the  mean  m^d).**  Assuming  that  the  time  evolution  of  m^(t)  consists 

of  deterministic  (e.g.,  trend,  seasonal)  as  well  as  stochastic  components 
describable  by  a  finite  order  Gauss-Markov  process ,  one  can  construct  a 
state  vector  model  of  the  following  type: 


Xj  (i+1)  =  't'jXjd)  +  v^(i); 
(i)  -  HjXj(i) 


i *  sample  number 


(4.3) 

(4.4) 


Here  x^(i)  is  an  n *  1  vector  of  state  variables,  where  n  is  the  sum 

of  the  orders  of  the  deterministic  and  stochastic  components.  V  (i)  is  a 

m 

Gaussian  white  noise  (i.e.,  uncorrelated  in  time)  sequence  with  mean  v 

and  covariance  Q^.  The  matrices  4  (n  *  n)  and  Hdl  x  n)  are  known  as  the 

state-transition  and  output  transformation  matrices.  The  definition  of 
the  state  vector  x^  (i)  is  not  unique,  and  any  other  vector  related  to 

Xj (i)  by  a  nonsingular  n x  n  transformation  matrix  is  also  a  state  vector. 

This  fact  can  be  used  to  simplify  the  structure  of  matrices  and  to 

certain  canonical  forms.  Once  the  canonical  forms  have  been  chosen,  the 

*To  be  more  precise,  payoff  should  be  denoted  as  rj(s,t). 

**An  obvious  extension  would  be  to  study  the  time  evolution  of  both  the 
mean  and  the  variance  of  r^(t). 
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dimension  of  the  state  vector  and  consistent  estimates  for  the  parameters 
are  obtained  by  using  Akaike's  Canonical  Correlation  Technique  (Akaike, 
1974). 

The  state  vector  model  of  Eq.  (4.3)-  (4.4)  does  not  take  into  account 
lagged  payoff  correlations  between  jobs.  For  example,  if  the  mean  payoffs 


nij  and  on  jobs  j  and  k  tend  to  be  correlated  with  each  other  at  dif- 


different  times,  an  augmented  state  space  model  may  be  defined  as  follows: 


Xj (i+i) 

xfc(i+l) 


"<f>  * 

V  J.k 

L  k.j*  \  J 


Xj  ( i )  I  rv  d)' 

xk(1)J  Lvk(i) . 


(4.5) 


V1*!  _  V°  h(1) 


mk(i)J  L°»  HkJLxk(1) 


(4.6) 


where  the  off-diagonal  block  matrices  $.  account  for  the  interaction 

j 

over  time  between  job  payoffs.  The  advantage  of  using  Eq.  (4.5)-  (4.6) 
is  that  the  predictions  of  nij(i)  and/or  m^i)  may  be  improved  since  one 

series  may  contain  leading- indicator  type  of  information  for  the  other 
series. 

Further  improvements  of  the  state  space  models  may  be  obtained  by  in¬ 
cluding  exogenous  variables,  denoted  by  vector  u.  Examples  of  possible 
exogenous  variables  that  would  influence  payoffs  are  better  educational 
background,  increased  standard  of  living,  special  training,  incentive  pro¬ 
grams,  improved  salaries,  advertising  and  special  recruitment  campaigns. 
The  exogenous  variables  can  be  included  in  Eq.  (4.3)-  (4.4)  as  follows: 


Xjd+l)  =  ♦  XjU)  +  Gu  (i)  +  V  (i)  (4.7) 

m  (i)  *  HjXj(i)  +  Duj(l)  (4.8) 

where  G  is  the  input  distribution  matrix  expressing  the  influence  of 
exogenous  variables  on  the  state  of  the  system. 

We  now  discuss  in  detail  the  state  space  modeling  methodology. 


State  Space  Models 


State  space  models  of  random  processes  are  based  on  the  Markov  property 
which,  in  simple  terms,  implies  the  independence  of  the  future  of  the 
process  from  its  past,  given  the  present  state.  In  other  words,  the  state 
of  a  Markov  process  summarizes  all  the  information  from  the  past  that  is 
necessary  to  predict  its  future.  For  obvious  reasons,  only  the  case 
where  the  state  vector  is  finite  dimensional  is  of  practical  interest.  A 
general  state  vector  model  is  typically  specified  in  terms  of  the  following 
five  quantities  (see  Figure  4.1):  (i)  three  vectors  respectively  of  input 

u(i),  output  y(i)  and  internal  state  variables  x(i);  (ii)  a  rule  for 
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Figure  4.1.  State  Vector  Model 
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transformation  of  the  state  vector  from  one  time  instant  to  the  next; 

(iii)  a  relationship  between  the  input-output  and  state  variables;  (iv) 
initial  state  x(D)  and  (v)  joint  statistics  of  all  random  variables. 
Mathematically, 

x(i+l)  =  f (x(i) ,  u(i) ,  G,  i)  +  v(i) 
y(i)  *  h(x(i) ,  u(i),  0,  i)  +  v(i) 
i  *=  0,  1,  2,... 

where  x(i)  is  nx  1  state  vector,  u(i)  is  r  x  1  input  vector,  w(i)  is  qx  1 
process  noise  vector,  G  is  ra  *  1  parameter  vector,  y(i)  is  pxl  output 
vector  and  w(i)  and  v(i)  are  assumed  to  be  uncorrelated  white  noise  se¬ 
quences  with  known  distributions.  Similarly,  the  distribution  of  x(0)  is 
assumed  known. 

All  mathematical  models  including  the  state  vector  model  are  only 
approximations  to  reality.  It  will  be  shown  here  that  a  number  of  models 
used  in  forecasting  can  be  written  in  the  form  of  Eq.  (4.9)  and  (4.10). 

If  the  model  is  physical  or  conceptual,  the  state  x(i)  has  a  physical 
meaning.  In  black-box  or  time  series  models,  the  state  need  not  have  a 
physical  meaning.  However,  it  still  possesses  an  abstract  mathematical 
meaning  stated  above  for  a  Markov  process. 

When  Eq.  (4.9)  and  (4.10)  are  linear,  then  the  model  is  known  as  a 
Gauss-Markov  model.  It  is  of  special  significance  and  is  written  as 

x(i+l)  -  <i>x(i)  +  Gu(i)  +  Tw(i)  (4.11) 

y(i)  =  Hx(i)  +  v(i )  (4.12) 

i  =  0,  1,  2,... 

where  w(i)  and  v(i)  are  assumed  to  be  Gaussian  white  noise  (GWN)  sequences 
with  zero  mean  and  covariances  Q  and  R.  The  initial  state  x(0)  is  normally 
distributed  with  mean  x  and  covariance  Pq.  The  matrices  $ ,  G,  H,  T,  Q, 

R  and  P  are  deterministic  but  may  be  time-varying.  The  main  advantage 
of  the  representation  (4.11)  and  (4.12)  is  that  the  mean,  covariance  and 
correlation  functions  for  x(i)  and  y(i)  can  be  computed  recursively  by 
solving  a  set  of  first  order  vector  difference  equations  (Bryson  and  Ho, 
1969).  Furthermore,  the  posterior  distribution  p(x(i)|y(i),  y(i-l) ,. . . ,y(l)) 
turns  out  to  be  Gaussian  and  its  first  two  moments  are  computed  recur¬ 
sively  by  the  Kalman  filter. 

Process  and  Measurement  Noise 

The  state  vector  model  (4.11)-  (4.12)  contains  two  white  noise  terms, 
namely,  process  noise  w(i)  and  measurement  noise  v(i),  which  physically 
have  quite  different  interpretations  and  effects.  v(i)  represents  the 
errors  inherent  in  observing  the  true  state  of  the  system  x(i),  whereas 
w(i)  represents  random  shocks  during  the  evolution  of  x(i).  If  we  neglect 
v(i)  and  assume  for  the  time  being  that  all  the  state  variables  can  be 
observed,  i.e.,  y(i)=*x(i)  and  all  matrices  are  time -invariant,  Eq.  (4.11) 
may  be  written  as 
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(4.9) 

(4.10) 


y(i+l)  =  4>y(i)  +  Gu(i)  +  Tw(i) 


(4.13) 


Eq.  (4.13)  represents  a  first-order  autoregressive  process  with  ob¬ 
served  input  (or  exogenous  variable)  u(i)  and  random  errors  w(i)  (Whittle, 
1963).  Chow  (1975)  and  Mehra  (1974)  show  how  econometric  simultaneous 
equations  models  may  be  written  in  the  form  of  Eq.  (4.13). 

Consider  now  the  case  where  there  is  no  process  noise,  i.e.,  w(i)  ;  0, 
and  the  initial  state  x(0)  is  known  perfectly.  Then,  given  (u(i)},  the 
(x(i)}  process  is  deterministic  and  Eq.  (4.12)  represents  a  signal  plus 
noise  model.  The  prediction  problem,  in  this  case,  consists  essentially 
of  separating  the  signal  from  the  noise.  Notice  that  this  nice  interpre¬ 
tation  may  be  lost  if  x(i)  =  y(i)  -  v(i)  is  substituted  into  Eq.  (4.11) 
yielding 

y(i+l)  =  4>y(i)  +  Gu(i)  +  (v(i+l)  -  4>v(i))  (4.14) 

Eq.  (4.14)  corresponds  to  a  vector  first  order  Autoregressive  Moving 
Average  (ARMA)  model  (Whittle,  1963).  The  same  type  of  model  is  obtained 
even  if  the  w(i)  term  is  kept  in  the  model. 

To  show  the  modeling  flexibility  of  the  state  vector  form,  we  consider 
the  following  examples: 

(i)  Time  Varying  Regression  Model.  Consider  a  time  varying  regression 
model  with  d(i)  as  the  dependent  variable  and  z^(i) , . . . , zffl(i)  as  the  in¬ 
dependent  variables. 

d(i)  -  ”  a.  (i)  z.  (i)  +  n(i)  (4.15) 

k=l  K  * 

Assume  further  that  the  time  variation  of  each  of  the  regression  coefficients 
may  be  described  by  a  first  order  scalar  model  with  random  shocks  £k(i)> 
namely 

ak(i+l)  =  aRak(i)  +  CkU>  (4.16) 


k  “  1, . . .  ,m 

Eq.  (4.15)  and  (4.16)  may  be  expressed  in  the  form  (4.11)-  (4.12)  by  de¬ 
fining 

y(i)  “  d(i),  n(i)  *  v(i) 

xT(i)  -  [a,(i),...,am(i)],  G  =  0,  T-I 
•  1  m 

H(i)  ■  Cz. (i) .... ,z  (i) 3 
i  m 


*1 

a2 

• 

♦  " 

• 

w(i)  - 

• 

r 

a 

■  3  . 

A(i>_ 
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(ii)  Error-in-Varlable  Model  (EVM)  with  Correlated  Independent  Variables. 
Suppose  that  in  Eq.  (4.15)  the  independent  variables  z.(i)  can  only  be  ob¬ 
served  as  b^(i)-with  errors  e^i),  i.e. ,  1 

bk(i)  -  zk(i)  +  ek(i)  k  «=  1 , . . .  ,m  (4.17) 

Suppose  further  that  zk(i)  may  be  modeled  as  first  order  scalar  Markov 
process,  namely: 

zk(i+l)  =  <fkzk(i)  +  SkU)  (4.13) 

The  model  of  Eq.  (4.15),  (4.17)  and  (4.18)  may  be  written  in  the  linear 

state  vector  form  (4.11)-  (4.12)  for  the  constant  coefficient  case  and  in 

the  nonlinear  form  (4.9)-  (4.10)  for  the  time  varying  case.  The  state 

vector  in  the  latter  case  consists  of  (z. (i) , . . .  ,z  (i),  a,(i),...,a  (i)). 

i  ml  m 

The  evolution  equation  (4.9)  is  linear  in  both  cases  (i.e.,  Eq.  (4.11)), 
but  the  output  equation  in  the  time  varying  case  involves  products  of 
states.  Models  of  this  form  can  be  used  to  develop  adaptive  Kalman  fil¬ 
ters,  in  which  the  desire  is  to  track  changing  coefficients  which  vary  in 
an  unpredictable  manner  (i.e.,  track  $  in  Eq.  (4.11)). 

4. 3  Recursive  State  Estimation  and  Kalman  Filter  Equations 

Consider  the  model  of  Eq.  (4.9)-  (4.10)  with  0  and  p(x(0))  specified. 
Recursive  equations  to  propagate  conditional  densities  are  derived  as  fol¬ 
lows,  starting  from  p(x(0)): 


p(x(i)|Y1)  -  p(x(i+l)|Y1)  -  p(x(i+l)|Yi+1) 

(prediction)  (update) 

where  Y*={y(i),  y(i-l),...,  y ( 1 ) }  denotes  the  set  of  all  observations 
available  at  time  t. 

One-step-ahead  prediction  is  done  using  the  state  equation  as  follows: 

p(x(i+l) | Y1)  =  / p(x(i+l),  x(i)|\4)  dx(i) 

-  /p(x(i+l) | x(i) ,Yi)p(x(i) ! Y1)  dx(i) 

-  JPw(i)(x(i+l)-f(x(i),  u(k),  0,  i))  x  (4*l9) 

p(x(i)|Y1)  dx(i) 

where  Pw^)(*)  denotes  the  probability  distribution  of  w(i)  and  the  inte¬ 
gration  is  carried  over  the  sample  space  of  x(i). 

Measurement  update  is  done  using  Bayes  Rule  as  follows: 


p(x(i+l)|Y1+1)  =  p(x(i+l) lY1,  y(i+l) ) 

„  P(v(i-H)lx(i+l))P(x(l+I)lY1) _ 

/p(y(i+l) jx(i+l))p(x(i+l) jY1)  dx(i+l) 


Notice  that 

p(y(i+l)  |x(i+l))  =  Pv(1+1)(y(i+D -h(x(i+l),u(i+l),0,(i+l)) 

where  Pv^+^  denotes  the  probability  distribution  of  v(i+l).  Also, 

Eq.  (4.19)  may  be  used  repeatedly  for  prediction  more  than  one  step  ahead. 

The  actual  forecasts  are  obtained  by  minimizing  the  loss  function 
averaged  with  respect  to  the  prediction  densities.  For  e::ample,  if  the 
loss  function  is  mean  square  forecast  (output)  error  one  step  ahead,  then 

the  mean  of  p(x(i+l)|Yi)  is  chosen  as  the  best  forecast.  Other  attributes 
of  a  density  function  commonly  used  in  practice  are  the  median  and  the  mode, 
the  former  minimizing  the  absolute  forecast  error  and  the  latter  selecting 
the  most  probable  value  of  the  random  variable.  (For  details,  see  Degroot 
(1970)  and  Bryson  and  Ho  (1969).) 

The  computation  of  Eq.  (4.19)  and  (4.20)  is  quite  cumbersome  due  to 
the  multi-dimensional  integrations  and  the  nonparametric  specification  of 
the  density  functions.  By  using  the  special  case  of  the  linear  Gauss- 
Markov  model  (Eq.  (4.11)  and  (4.12)),  elegantly  simple  results  are  ob¬ 
tained  due  to  the  following  facts: 

a)  Linear  transformations  of  Gaussian  random  variables  are  also 
Gaussian. 

b)  The  Gaussian  family  has  the  conjugate  property  that  for  Gaussian 
priors  and  Gaussian  likelihood  functions,  the  posterior  distri¬ 
butions  are  also  Gaussian. 

c)  Gaussian  distributions  are  completely  specified  by  their  first 
two  moments,  i.e.,  mean  and  covariance. 

A  justification  for  using  the  Gaussian  assumption  comes  from  the 
central  limit  theorem  according  to  which  the  limiting  sums  of  non-Gaussian 
independent  random  variables,  under  certain  regularity  conditions,  have 
Gaussian  distributions. 

Kalman  filter  equations.  Let  the  mean  and  the  covariance  of  the 

Gaussian  density  function  p(x(i+l)  | Y^)  be  denoted  by  x(i+l)|i)  and  P(i+lji), 
respectively.  We  would  also  denote  the  same  as 

p(x(i+l)|Yi)  -v  N(S(i+l)|i),  P(i+l)|i)) 

where  N(a,b)  signifies  "distributed  normally  with  mean  a  and  covariance 
b."  Similarly,  let 

p(x(i)|Yi)  ^  N(x(i| i),  P(i|i)) 

Eq.  (4.19)  leads  to  the  following  two  equations: 
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Prediction  equations : 

x(i+l | 1)  =  *(i)x(i |i)  +  G(i)u(i)  (4.21) 

P(i+l|i)  =  <f>(i)P(i|i)l>T(i)  +  r(i)0(i)rT(i)  (4.22) 

Eq.  (A. 20)  leads  to  the  following  equations: 

Update  equations: 

x(i+l | i+1 )  =  x(i+l | i)  +  K(i+1) v(i+l)  (4.23) 

v(i+l)  =  y(i+l)  -  H(i+l)x(i+l | i)  (4.2A) 

K(i+1)  =  P ( i+ 1 | i )  HT(i+l)E-1(i+l)  (4.25) 

I (i+1)  =  H(i+l)P(i+l I i)HT( i+1 )  +  R(i+1)  (4.26) 

P(i+1 | i+1)  -  [I  -  K(i+l)H(i+l) ]P(i+l j i)  (4.27) 

Initial  conditions: 

x  (0 | 0)  =  xQ  (4.28) 

P(0|0)  =  PQ  (4.29) 


Eq.  (4.21)-  (4.27)  constitute  the  basic  Kalman  filtering  equations 
and  they  are  solved  recursively  starting  from  the  initial  conditions 
(4.28)  -  (4.29)  in  the  sequence  (4.21),  (4.22),  (4.24),  (4.26),  (4.25), 
(4.23)  and  (4.27).  For  predictions  more  than  one  step  ahead  into  the 
future,  only  Eq.  (4.21)  and  (4.22)  are  used  recursively.  Since  for  Gaus¬ 
sian  density  functions,  the  mean,  mode,  and  median  are  the  same,  the 
k-step- ahead  forecasts  x(i+k|i)  will  be  optimal  for  a  whole  class  of 
symmetric  loss  functions — that  is,  even  functions  of  estimation  error 
(Degroot,  197C) .  The  covariance  matrix  P(i+k|i)  provides  confidence  limits 
for  the  forecasts  x(i+kji).  The  prediction  and  update  steps  are  illus¬ 
trated  in  Figure  4.2. 


4 . 4  Properties  of  Ka  Irian  Filters 

In  addition  to  the  optimality  properties  stated  above  in  the  Bayesian 
decision  theory  sense,  the  Kalman  filters  have  a  number  of  other  interestin 
properties  of  practical  significance.  We  mention  these  properties  here 
without  detailed  proofs. 

(i)  Innovation  property.  The  one-step  ahead  prediction  error  sequence 
v(i)  =  y ( i)  -  iix ( i  i- 1 )  is  known  as  the  "innovation  sequence"  since  it  rep¬ 
resents  new  information  brought  by  observations  y(i)  in  addition  to  the 

information  contained  in  the  past  observation  history  Y*  The  sequence 

v(i)  has  the  interesting  property  that  for  an  optimal  filter  it  is  a  zero 
mean  Gaussian  whte  noise  sequence  with  covariance  1.(1).  It  will  be  shown 
in  the  sequel  how  this  property  may  be  used  to  test  the  optimality  of 
Kalman  filters,  to  detect  changes  in  the  process  model  and  to  build  adap¬ 
tive  and  robust  Kalman  filters.  It  has  been  shown  by  Kailath  (1968)  that 


the  innovation  property  follows  directly  from  the  orthogonality  principle 
of  linear  least  squares  estimation  and  that  this  property  may  be  used  as 
a  starting  point*  for  the  derivation  of  the  Kalman  filter.  Furthermore, 
since  (v(i)}  may  be  obtained  from  { y ( i ) }  by  a  causal  and  a  causally-inver- 
tible  transformation,  the  innovation  sequence  contains  as  much  information 
as  the  original  observation  sequence. 

(ii)  Stability .  It  has  been  shown  by  Kalman  (1963)  and  others  that 
the  Kalman  filter  possesses  the  property  of  global  asymptotic  stability 
for  a  completely  controllable  and  observable  system.  The  last  two  pro¬ 
perties  of  the  system  are  of  central  importance  in  modern  system  theory 
and  relate  to  the  structure  of  the  system  matrices  $,  F  and  H.  For  time 
invariant  systems,  necessary  and  sufficient  conditions  for  the  system  of 
Eq.  (4.11)-  (4.12)  to  be  completely  controllable  and  observable  are  that 
the  rank  of  the  following  two  matrices  be  n,  where  n  is  the  dimension  of 
the  state  vector,  i.e., 

Ranker . .  ,^n_1n  =  n  (4.30) 

Rank  [hW . (i>n_  1  )THT  ]  =  n  (4.31) 

The  physical  interp re ta t ion  or  the  observability  property  is  that  for 
a  noise-free  observable  system,  the  initial  state  x(0)  can  be  reconstructed 
uniquely  from  the  noise-free  measurements  at  n  time  instants,  that  is, 

{  y  (  1 )  ,  .  .  .  ,  v  (  n )  1 

The  control  lab  i  1  i  t  v  prenertv  the  existence  of  a  control  sequence 

transferring  the  system  from  a  /iven  in. Mil  state  to  any  other  state  in 
finite  time  and  with  finite  . on: r  >  1  en.  r.  v. 

The  practical  significance  or  th<  -or.  trol  tab  i  1  itv  and  observability 
conditions  are  that  for  time-  inv  ir  iant  •..•••.terns,  the  filter  covariance 
matrices  (P(i-fl  i),  P  ( i !  i  >  )  and  Kalman  coin  Kii)  reach  constant  steady 
state  values,  independent  of  the  initial  conditions.  Furthermore,  since 
these  matrices  can  be  precomputed  (without  hiving  observations  {y(i)f), 
the  real-time  Kalman  filter  computations  can  be  reduced  to  Co.  (4.21), 
(4.23)  and  (4.24).  In  many  app  lio.it  i  ons .  the  assumption  of  constant 
Kalman  filter  gain  does  not  degrade  filter  performance  by  very  much,  but 
results  in  significant  computation  il  savings.  Wiener  filtering  (Wiener, 
1949)  for  stationary  processes  also  corresponds  to  this  case. 

(iii)  Numerical  properties.  The  Kalman  filter  equations  (4.21)- 
(4.27)  can  be  written  in  different  forms  with  different  numerical  pro¬ 
perties.  Unfortunately,  the  equations  (4.21)  -  (4.27)  known  as  the  covar¬ 
iance  form  of  the  Kalman  filter,  though  physically  easiest  to  comprehand, 
are  not  best  suited  for  numerical  computation.  In  systems  with  widely 
separated  eigenvalues  of  the  filter  covariance  matrices,  round-off  errors 
can  lead  to  non-negative  definite  covariance  matrices.  A  solution  to  the 
problem  is  obtained  by  using  Choleskv  square  roots  of  the  covariance 
matrices  by  equations  of  the  type: 

P(i | i)  =  S(i|i)ST(i| i) 
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(4.32) 


r 


Recursive  equations  are  developed  for  S(i|i),  and  Eq.  (4.32)  is  used 
to  compute  P(i|i).  Another  advantage  of  this  approach  is  improved  accuracy 
on  finite  bit  machines  since  the  condition  number  of  S(i|i)  is  half  that 
of  P ( i | i) .  In  particular,  the  accuracy  of  single-precision  square  root 
Kalman  filters  is  comparable  to  that  of  double-precision  covariance  Kalman 
filters.  The  triangular  factorization  of  P(iji)  offers  several  other  ad¬ 
vantages  which  are  discussed  in  a  recent  book  by  Bierman  (1976). 

Kalman  filter  equations  can  also  be  written  in  terms  of  the  informa¬ 
tion  matrices  which  are  defined  as  the  inverses  of  the  covariance  matrices 
(see  Schweppe,  1973).  The  information  form  has  the  nice  property  that  the 

prior  information  Pq*  can  be  set  to  zero  without  any  numerical  difficulties. 

The  information  form  also  plays  a  role  in  square  root  filtering  and  in 
systems  with  Fisher-unknown  inputs  (Schweppe,  1973;  Mehra,  1975).  In 
the  latter  case,  the  limit  Q -*■  “I  is  considered  to  model  input  forcing 
functions  that  are  deterministic  but  completely  unknown  (i.e.,  no  prior 
information  on  (v(i)}). 

Cases  in  which  the  measurement  noise  is  correlated  or  some  of  the 
measurements  are  noise-free  have  been  considered  by  Bryson  and  Henrick- 
son  (1968).  It  is  possible  to  reduce  the  size  of  the  Kalman  filter  in 
these  cases.  Other  techniques  for  reducing  the  dimension  of  Kalman  fil¬ 
ters  are  discussed  in  Galdos  and  Gustafson  (1977). 
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5.  STATE  SPACE  MODEL  STRUCTURE  DETERMINATION 


Multidimensional  or  multiple  time  series  are  encountered  commonly 
in  economic,  sales,  production,  financial,  scientific  and  engineering 
applications.  Even  so,  one  finds  very  few  techniques  in  the  literature 
for  their  modeling  and  forecasting.  The  univariate  time  series,  on  the 
other  hand,  has  received  considerable  attention  and  has  been  used  exten¬ 
sively  by  Box  and  Jenkins  (1970)  and  others  for  modeling  and  prediction. 
Several  attempts  have  been  made  over  the  last  decade  to  extend  the  Box- 
Jenkins  approach  to  multiple  time  series.  However,  most  of  these  attempts 
have  failed  because  the  multiple  time  series  case  requires  certain  new  con¬ 
cepts  and  techniques  not  present  in  the  Box-Jenkins  approach. 

Recently  certain  groundbreaking  developments  in  the  field  of  systems 
identification  and  control  theory  (IEEE,  1974;  Mehra  and  Lainiotis,  1976) 
have  led  to  a  new  approach  to  the  modeling  and  forecasting  of  multiple 
time  series.  This  chapter  describes  the  theory  and  application  of  a 
computer  program  based  on  the  new  approach  which  can  analyze  a  large 
number  of  time  series  simultaneously,  limited  only  by  the  size  of  the 
computer  memory  available  for  the  storage  of  data.  The  program  can  per¬ 
form  differencing  and  choose  the  order  of  the  model  automatically  so  that 
user  intervention  is  minimal.  Even  on  univariate  time  series,  the  program 
has  been  found  to  be  more  convenient  and  faster  to  use  than  the  Box-Jenkins 
method. 

5. 1  Theoretical  Basis 

The  program  is  based  on  state  space  models,  stochastic  realization 
theory,  statistical  decision  theory,  canonical  correlation  analysis  and 
Kalman  filtering  combined  in  a  unique  way  for  multiple  time  series  analysis. 
A  brief  discussion  of  the  technical  aspects  is  given  below.  For  full 
technical  details,  the  reader  should  consult  a  chapter  by  Akaike  in  Mehra 
and  Lainiotis  (1976). 

5 . 2  State  Space  Models 

The  state  of  a  system  is  defined  as  a  collection  of  all  information 
from  the  present  and  past  history  of  the  process  sufficient  to  predict  its 
future  behavior.  The  state  vector  may  be  defined  from  theoretical  con¬ 
siderations  or  from  an  analysis  of  the  past  history  of  a  process.  The 
former  approach  leads  to  a  theoretical  or  physical  model  such  as  the  sim¬ 
ultaneous  equation  models  of  economics  (e.g.,  Klein’s  model  of  the  U.S. 
economy),  dynamical  models  of  mechanics,  or  circuit  models  of  electrical 
engineering.  These  models  are  too  specialized  to  be  made  part  of  a  general 
purpose  program  for  multiple  time  series  forecasting.  In  practice,  there 
are  many  processes  and  systems  for  which  theoretical  models  are  not  avail¬ 
able,  and  statistical  models  have  to  be  developed  directly  from  the  data. 
This  chapter  describes  an  approach  which  achieves  this  statistical  model 
development  by  identifying  the  state  of  the  system  from  a  canonical  cor¬ 
relation  analysis  of  the  observed  data  and  by  using  state  vector  canonical 
models  whose  parameters  are  uniquely  defined  from  the  input-output 
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properties  of  the  system. 

Let  y(i),  i=  1,2,3,... ,N  be  a  p-diraensional  vector  of  an  observed 
time  series.  Then  a  state  vector  model  of  the  process  is  of  the  form 

x(i+l)  =  Fx(i)  +  Gv(i+1)  (5.1) 

y(i)  -  Hx(i)  (5.2) 

where  x(i)  is  an  n-dimensional  vector  of  state  variables  (generally  n > p) 
and  v(i+l)  is  a  p-diraensional  vector  of  one-step-ahead  prediction  errors 
or  "innovations"  which  is  a  zero  mean  white  noise  process.  Matrices  F, 

G,  and  H,  respectively  n  x  n,  n*p,  and  p  *  n,  depend  on  the  statistical 
properties  of  the  process.  The  covariance  matrix  of  v(i)  is  denoted  by  E. 
The  system  of  equations  (5.1)  and  (5.2)  is  completely  specified  in  terms 
of  the  quantities  (n,F,G,H,E) .  It  is  shown  easily  that  the  state  vector 
model  of  Eq.  (5.1)  and  (5.2)  is  equal  to  an  ARMA  model  in  the  sense  that 
both  models  will  produce  an  output  series  v(i)  with  identical  statistical 
properties.  However,  there  are  several  advantages  in  using  state  vector 
models  instead  of  multidimensional  ARMA  models.  These  are: 

(i)  Once  the  state  vector  model  is  identified,  prediction  or  fore¬ 
casting  is  done  trivially  by  setting  v  2  0  for  all  future  values  of  t. 

The  prediction  of  some  of  the  series  when  the  future  values  for  the  rest 
are  known  is  also  done  easily  by  using  a  Kalman  filter. 

(ii)  A  multidimensional  ARMA  model  of  the  type 

y(i)  +  B.y(i-l)+  ...  +  B  y(i-m)  =  u(k)  +  A.u(i-l)  +  . . .  +  A  u(i-L) 

1  ID  i.  1-* 

is  not  unique  in  the  sense  that  a  large  number  of  matrices  (B,...B  , 

i  m 

A^...A^)  may  produce  a  y(i)  series  with  identical  statistical  properties. 

(This  problem  does  not  arise  for  univariate  series.)  The  same  problem 

exists  for  the  state  vector  model  but  it  is  easiiv  solved  by  restricting 

(F,  G,  H)  to  the  so-called  "canonical  forms"  (Mehra  and  Lainiotis,  1976). 

The  restrictions  on  (B,...B  ,  A,... A.)  are  more  complicated  and  are  dif- 

1  m  1  L 

ficult  to  incorporate  easily  in  an  identification  program. 

5. 3  Stochastic  Realization  Theory 

The  problem  of  determining  the  internal  structure  of  a  st3te  vector 
model,  namely  (n,F,G,H,L)  given  its  external  behavior,  namely  the  cor¬ 
relation  function  (Cq,Cj ^2* • • . )*  of  the  output  v(i)  is  called  the  sto¬ 
chastic  realization  problem.  Further  conditions  such  as  thp  minimality 
of  n  and  the  uniqueness  of  (F,G,H,I)  are  imposed  to  develop  a  parsimcr. ious 
representation  whose  parameters  can  be  identified  uniquely  from  the  data. 
It  should  be  noted  that  stochastic  realization  theory  by  itself  does  not 

Ck  =  N-k  J,  y(i)y(i"k)T 

i=k 
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solve  completely  the  problem  of  multiple  time  series  modeling  since  the 
correlation  function  (Cq,Cj,...)  is  not  known  exactly  and  must  be  estimated 

from  the  observed  time  series  (y(]),y(2) . y(N)).  This  problem  is 

solved  by  using  tools  of  statistical  decision  theory  and  canonical  cor¬ 
relation  analysis,  discussed  by  Akaike  in  Mehra  and  Lainiotis  (1976). 

Statistical  decision  theory  is  used  in  the  development  of  the  in¬ 
formation  criterion  and  the  test  statistic  for  selection  of  model  order 
(Akaike,  1974).  Autoregressive  (AR)  models  of  different  orders  are 
developed  using  a  Levinson-Whittle-Wiggins-Robinson  algorithm  and  are 
employed  in  tests  of  fit,  determination  of  G,  and  in  generating  forecasts 
for  cross-checking  with  the  state  vector  model. 

A  flow  diagram  of  the  procedure  is  shown  in  Figure  5.1.  The  basic 
concept  behind  the  method  is  that  the  state  vector  of  a  system  at  current 
time  i  may  be  defined  as  a  basis  vector  for  the  space  spanned  by  the  cur¬ 
rent  output  and  future  predictions: 

{y(i).  y(i+l|i) . y(i+kji) . } 

(This  space  is  referred  to  as  the  "prediction  space"  of  a  system  at  time  i, 
since  y(i+k|i)  is  the  predicted  estimate  of  v(i+k)  based  on  observations 
up  to  time  i.)  It  can  be  shown  that  this  space  is  finite  dimensional  for 
a  finite  dimensional  system  and  that  the  dimension  of  the  system  can  be 
determined  by  examining  the  canonical  correlations  between  two  sets  of 
variables  U  and  V.  for  k=  1,2,3,...  where 

U  *=  (yT(i)  ,yT(i-l) . yT(i-k)},  k  sufficiently  large,  and 

Vk  =  {yT(i),yT(i+lji),...,yT(i+k|i)} 

By  increasing  k  one  at  a  time  and  by  considering  elements  of  y  in  a 
given  order,  the  state  vector  x(t)  of  the  system  is  determined  as  a  sub¬ 
set  of  as  shown  in  Figure  5.1.  Once  the  state  vector  is  identified, 

the  matrix  F  is  determined  simultaneously  from  the  canonical  variables. 

The  purpose  of  fitting  the  AR  model  and  computing  the  impulse,  response 
function  is  to  estimate  the  Kalman  gain  matrix  G  and  the  innovation  co- 
variance  matrix  Z.  Notice  that  the  procedure  identifies  the  stationary 
Kalman  filter  model  directly  and  does  not  involve  solving  Riccati  equations. 

5.4  Transformation  to  Stationaritv 

The  program  can  perform  automatic  differencing  and  deseasonalizing 
to  convert  the  given  time  series  individually  to  stationary  ones.  The 
tests  of  stationarity  and  the  choice  of  the  seasonality  period  are  based 
on  the  autocorrelation  function.  The  automatic  differencing  (one  period 
and  seasonal)  are  continued  until  the  transformed  series  passes  the 
stationarity  test. 

The  program  has  already  been  used  successfully  on  a  number  of  time 
series,  both  multivariate  and  univariate.  It  has  the  advantage  that  no 
cumbersome  and  time-consuming  nonlinear  searches  are  performed  to  estimate 


2F. 


the  parameters.  The  canonical  correlation  and  AR  modeling  techniques 
provide  asymptotically  efficient  estimates  of  all  system  parameters  (Mehra 
and  Lainiotis,  1§76). 

5.5  Development  of  Kalman  Filter  from  Canonical  State  Space  Model 

Once  the  state  space  model  is  specified,  the  next  step  is  to  derive 
the  Kalman  filter  from  it. 

The  Kalman  filter  is  based  on  a  system  model  of  the  form 

x(i+l)  =  <5x(i)  +  v(i+l)  (5.3) 

y(i)  =  TxU)  +  v(i)  (5.4) 

where  Lhe  initial  state  x(0)  is  a  Gaussian  random  variable  with  mean 
and  covariance  matrix  and  w(i),  v(i)  are  mutually  independent  zero 

mean  Gaussian  white  noise  sequences  with  respective  covariances  W,  V. 

The  Kalman  filter  produces  the  minimum-variance  estimate  recursively 
according  to 

x(i+l | i)  =  $x(i | i)  (5.5) 

x(i+l|i+l)  =  x1(i+l|i)  +  K(i+l)r (i+1)  (5.6) 

where  x(i+l|i)  is  the  one-step-ahead  prediction  of  x,  and  r(i+l)  is  the 
one-step-ahead  output  prediction  error 

r (i+1)  =  y(i+l)  -  Fx(i+l|i)  (5.7) 

The  initial  condition  is  x(0)  =  m.  The  gain  matrix  K(i+1)  is  computed 
according  to 


K(i+1)  =  P(i+l|i)rTS(i+l)-1  (5.8) 

S(i+1)  =  FP(i+l ] i) rT  +  V  (5.9) 

where  P(i+lji),  S(i+1)  are,  respectively,  the  one-step -ahead  state  and 
output  error  covariance  matrices.  P(i+1)  is  the  covariance  matrix  of 
estimation  errors  which  is  computed  recursively  by 

P (i+1 | i)  =  $P(i|i)0T  +  W  (5.10) 

P (i+1 | i+1 )  =  P(i+l j i)  -  K(i+l)FP(i+l |i)  (5.11) 

with  initial  condition  P(0|0)=P  .  Since  the  state  space  model  is  a 

steady  state  one,  we  are  interested  in  the  steady  state  Kalman  filter  in 
which  K(i)  =  K  Vi,  P(i| i)  = P  Vi,  S(i)  =  S  Vi,  P ( i+i | i)  =  P'  Vi. 

In  this  case  the  equations  to  be  solved  are 

K  =  PTTS-1  (5.12) 
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(5.13) 


s  »  rp’rT  +  v 

P*  =  <$P$T  +  W  (5. 14) 

P  »  P'  -  KFP'  (5. 15) 

The  Kalman  filter  has  the  desirable  property  that  the  sequence  {v(l)} 
is  a  zero-mean  Gaussian  white  noise  sequence  with  covariance  natrix  5.. 

n  t 

By  comparing  the  Kalman  filter  and  state  space  models,  the  following  cor¬ 
respondences  are  seen  to  hold: 


State  Space  Model 

G 

H 

i 

Kalman  Filter 

K 

r 

_s_ 

In  order  to  proceed  further,  we  will  take  advantage  of  the 
form  of  the  state  space  equations.  The  state  vector  x(i)  is  of 


spec ia 1 
the  form 


x(i) 


y(i) 

yr(i) 


(5.16) 


where  yr(i)  is  an  n-m  vector  which  contains  predicted  values  of  the  com¬ 
ponents  of  y(i).  Now  we  note  that  the  state  space  model  is  of  the  form 


x(i+l  |  i+1)  =  4>x(i  |  i)  +  Gv(i+1)  (5.17) 

v(i+l)  -  y(i+l)  -  y(i+l  i)  (5.18) 

y(i+l)  -  Hx(i+1)  (5. 19) 

where 

x(i | k)  *  E[x(i) |y(l),y(2),...,y(k) J  (5.20) 


is  the  conditional  expectation  of  x(i),  bss»?i  on  data  up  to  y(k).  Sine- 
y(i+l | i+1)  =  y (i+1) ,  K  is  of  the  form 


K 


I 


mxn 


r 

(n-m)*m 


(5.21) 


is  of  the  form 


mxm 
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- - -  -  + 

*21,  x  '  *22 

(n-m)xm  i 


m*(n-m) 


(5.22) 


(n-m) x (n-m) 


and  H  is  of  the  form 


H  =  [  r  v  I  0  .  .  ] 

taxm  '  m*  (n-m) 


(5.23) 


Eq.  (5.17)-  (5.19)  correspond  to  the  Kalman  filtering  equations  for  per- 
fect  measurements.  Thus  P  assumes  the  form 


0 


mxm 


0 


mx (n-m) 


0  P 

L  (n-tn)xm  1  (n-m)x(n-m) 


(5.24) 


The  remaining  question  is  the  form  of  P'  and  the  driving  noise  covar¬ 
iance  matrix  W.  Partition  W  as 


w 

11 

raxn 

W 

12 

rax (n-m) 

1 - 

— **H 

w 

22 (n-m) x (n-m) 

and  P'  as 


(5.25) 


P' 


_pi_ 

.  K 
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Then  Eq.  (5. 12)  -  (5. 15)  yield 


Pr  -  P^  -  KrE(Kr)T 

1  "  <5’l2P  $12  +  WU 
E(Kr)T  -  *I2Pr^2  +  W12 

p'  «  <t  pr«t-  +  W 

3  22  22  22 

P^  -  I(Kr)T 

P1  *  £ 


(5.26) 


(5.27) 

(5.28) 

(5.29) 

(5. 30) 

(5.31) 


In  these  equations,  there  are  (n-m+1 ) (n-m) / 2  frpe  variables  which  may  be 
specified.  One  solution  is  to  specify  >  0;  for  example 


W  ,  -  02I 
22  n-m 


(5.33) 


However,  there  are  constraints  on  W?2  which  need  to  be  met.  To  see  this, 


write  (5.30)  in  the  form 


pr  "  4’22pr<!>22  +  [w22"  Kri:(Kr>T]  (5.34) 

If  4>22  Is  unstable,  we  can  get  a  solution  by  picking 

0  £  W22  <  KrI(Kr)T 

On  the  other  hand,  if  <I>22  Is  stable,  then  we  are  assured  of  a  solution  if 
r  r  T 

W22  >  K  I(K  )  .  An  approximate  value  of  W22  can  also  be  picked  by  statis¬ 
tical  tests  on  the  original  data.  For  example,  the  covariance  matrix  of 
—  T 

x,  X*  E[x(i)x(i)  ],  may  be  calculated  for  the  data  ensemble  and  then  W 
found  from 


W  =  X-  4X$T  >  0 

Note  that  this  implies  stability  of  $,  which  we  expect  in  practice  since 
the  payoffs  are  bounded.  Using  (5.25),  W22  can  then  be  estimated.  A  fur¬ 
ther  check  is  that  the  two  computed  values  of  should  agree,  at  least 

approximately. 

Once  W22  is  selected,  Pr  is  found  directly  from  (5.34)  by  solving  a 

|- 

linear  vector-matrix  equation  by  writing  out  the  components  of  P  in 
vector  form.  The  values  of  P|,  P2>  P^»  ^  and  WJ2  are  then  computed 

directly,  which  completely  specifies  the  parameters  of  the  Kalman  filter. 

Given  the  model  of  (5.17)-  (5.19),  predictions  can  be  easily  made  by 
noting  that  the  predicted  value  of  y(i+k)  given  data  y( 1) ,y(2) , . . . ,y(i) 

is 

y(i+k|i)  -  [I  ;  0]$kx(i!i);  k  i'  0  (5.35) 

The  advantage  of  using  the  Kalman  filter  form  is  that  some  very  powerful 
adaptive  filtering  techniques  have  been  developed  using  this  form  and 
these  may  be  easily  mechanized  for  solving  the  PJM  problem.  We  will 
discuss  in  Chapter  7  the  adaptive  filtering  problem  and  then  develop  a 
specialized  approach  for  the  PJM  problem. 


6.  STATIONARY  STATE  SPACE  MODELS  -  RESULTS 


6. 1  Introduction 

In  order  to  apply  the  methodology  of  stationary  state  space  model 
identification  given  in  the  preceding  sections  to  the  PJM  payoff  series, 
a  number  of  stationary  models  were  identified  using  the  S^I  state  space 
identification  program.  This  program  implements  the  process  of  automatic 
differencing  determination,  canonical  correlation  analysis,  model  order 
determination,  parameter  identification  and  forecasting.  It  is  capable 
of  producing  a  number  of  outputs  such  as  the  identified  model,  forecasts 
with  upper  and  lower  95  percent  confidence  limits,  goodness-of-f it  statis¬ 
tics,  etc. 

The  models  reported  in  this  section  will  consist  of  models  derived 
only  for  the  payoff  series  dataset.  Because  of  the  large  amount  of  out¬ 
put  associated  with  each  model,  only  a  representative  sample  of  outputs 
will  be  presented.  A  summary  of  the  state  space  model  error,  12-month 
moving  average  model  error  and  persistence  model  error  for  13  male  and 
13  female  series  is  given  in  Table  1  of  Appendix  B.  The  state  space 
models  for  these  series  were  produced  then  by  identifying  the  system  on 
the  first  4  years  of  data  (1973-1976)  and  then  predicting  the  series  for 
the  last  year  (L977). 

The  persistence  model  was  taken  to  be  the  value  of  the  series  for 
December  1976  and  forecasting  no  change  over  1977.  The  moving  average 
model  was  taken  to  be  the  average  of  the  preceding  12  months  (January 
1976  to  December  1976)  with  no  change  forecast  for  1977. 

A  listing  of  the  abbreviated  output  from  the  state  space  model  pro¬ 
gram  with  plots  of  the  historical  d3ta  and  12-month  predictions  are  given 
in  Appendix  B,  Tables  2  through  27  and  Figures  B.l  through  B.52.  In 
these  figures,  the  suffix  TH  stands  for  the  one  step  ahead  prediction  of 
the  history  over  the  four-year  fit  set,  P  stands  for  the  12-month  pre¬ 
dictions,  and  PI'  and  PL  stand  for  the  upper  and  lower  95  percent  confidence 
limits  on  the  predictions. 

6 . 2  Discus si ( ’ n_o f  Resul ts 

The  results  of  the  experiment  cannot  be  termed  encouraging.  The 
models  developed  for  all  the  male  series  and  ail  but  several  of  the  female 
series  do  not  contain  leading  terms  as  state  variables  and  so  are  simple 
first-order  models.  For  many  of  the  male  series  and  several  of  the  fe¬ 
male  series,  first  order  differencing  was  performed  to  obtain  a  more  sta¬ 
tionary  behavior.  In  those  cases,  the  state  transition  element  value  was 
quite  small,  often  of  magnitude  0.1  or  0.2.  This  fact,  taken  with  the 
low  order  models,  tends  to  indicate  that  the  series  have  quasi-random  walk 
character.  This  hvpothosis  is  borne  out  when  the  performance  of  the  state 
space  models  is  evaluated  against  a  persistence  predictor  which  is  optimum 
for  predicting  a  r  indom  walk  process.  For  the  majorite  f  the  male  series, 
the  persistence  predictor  performs  better  than  the  state  space  model,  even 
though  tin  fit  of  the  model  over  the  earlier  4  vears  is  good.  In  examining 
the  series  fur  which  the-  state  space  model  performance  is  poor,  it  is  noted 
that  the  model  tends  to  overestimate  the  series  due  to  the  unforeseen 


leveling  off  and  even  decline  in  the  series  values  during  1977.  It  is 
precisely  this  type  of  behavior  that  may  violate  the  assumption  of  statis 
tical  stationaritiy  for  the  PJ  series  payoff  data  and  make  the  problem 
more  suitable  for  treatment  by  the  adaptive  methods  covered  in  later 
sections. 

The  performance  of  the  state  space  models  on  the  female  time  series 
data  is  superior  to  that  of  the  male  series  when  scored  against  a  persis¬ 
tence  predictor.  The  models  produced,  however,  have  much  the  same  charac 
ter  as  the  male  models  except  for  the  two  series  in  which  leading  terms 
were  found.  The  E80F  series  (F30230)  was  the  worst  to  predict,  with  the 
model  being  basically  series  mean.  Other  models  often  achieved  an  R-  of 
0.8  or  0.9  against  the  original  series  data,  but  showed  poor  performance 
against  the  differenced  data. 

In  summary,  it  should  be  concluded  that  the  time-invariant  state 
space  models  are  probably  not  suitable  for  prediction  of  payoff  series 
data  due  to  the  sudden  shifts  in  the  series.  These  series  will  probably 
be  treated  better  by  adaptive  filters  than  any  constant  valued  model. 


7.  ADAPT  l  VK  K  A I.  VAN  FI  J/'FKl  VI  NFTUODO.'.O'iY  FOR  PJM  PAYOFF  DATA 


7.1  Mot  i vat  i tin 

Although  the  Kalman  filter  has  many  desirable  properties,  it  suffers 
from  some  i undanental  limitations.  One  such  limitation  is  that  the  ma¬ 
trices  'v ,  K  must  be  known  a  priori.  These  ma  trices  may  he  time  vary  in", 
but  if  this  time  variation  is  known  a  priori,  the  Kalman  filter  remains 
opt imal . 

The  situation  changes,  however,  when  <1  changes  in  an  unpredictable 
manner  or  the  statistics  of  the  process  noise  changes.  We  may  indicate 
this  more  precisely  by  writing  the  steady-state  Kalman  gain  matrix  in 
the  form 


K  =  P’HTZ  1  (7.1) 

where  P1  is  the  error  covariance  matrix  for  the  estimate  x(i+l|i)  and  I 
is  the  covariance  matrix  for  the  innovations  (I  is  outputted  directly  by 
the  state  space  modeling  program).  The  matrix  P*  is  given  by 

P’  =  <JP0T  +  W  (7.2) 

where  P  is  the  error  covariance  matrix  for  the  estimate  x(i+lji+l)  and  W 
is  the  covariance  matrix  for  the  process  noise.  Assuming  a  Markov  process 
of  the  form 

x( i+1)  =  <fx(i)  +  w(i)  (7.3) 

where  x(i)  is  the  true  state,  then 

W  =  E[w(i)wT(i) ]  (7.4) 

Using  (7.3)  as  our  model  of  the  true  state,  P  and  P'  are,  respectively, 
the  covariances  of  x(iji)  -x(i)  and  x(i+iji)  -x(i). 

It  is  clear  that  the  gain  matrix  K  changes  if  )  cr  K  changes.  Thus 
if  the  dynamics,  modeled  by  $,  or  the  process  noise  statistics,  modeled 
by  W,  change  with  time  in  an  unpredictable  manner,  we  need  to  develop  a 
technique  for  estimating  them. 

Previous  numerical  studies  on  the  PJM  payoffs  have  suggested  that  the 
underlying  process  changes  with  time.  Figures  7.1 -7.6  show  the  12-ronth 
moving  average  for  several  payoffs  during  the  period  1974-1977.  It  is 
clear  that  the  dynamics  change  significantly  over  the  entire  5-year  period 
but  tend  to  persist  over  at  least  several  months.  That  is,  the  variation 
in  the  dynamics  is  not  entirely  random.  The  payoff  for  F42333  has  dy¬ 
namics  which  appear  to  change  at  discrete  points--the  middle  of  1975  and 
the  beginning  of  1977.  Otherwise,  the  dynamics  for  this  payoff  appear  to 
be  the  same.  For  payoff  F20530,  the  dynamics  change  abruptly  at  the 
middle  of  1975,  but  change  only  gradually  thereafter.  The  payoff  for 
M67232  undergoes  abrupt  changes  in  dynamics  in  the  middle  of  1974,  the 
middle  of  1  975  and  the  middle  of  1970.  The  dynamics  for  the  M.77131  p.ivoff 
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Figure  7.3.  12-Month  Moving  Average  for  M67232  Payoff 
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Figure  7.6.  12-Month  Moving  Average  for  M30230  Payoff 
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undergo  an  abrupt  change  in  the  beginning  of  1976  and  a  gradual  change 
during  1976  and  1977.  The  dynamics  for  the  F46330  payoff  are  seen  to 
undergo  abrupt  changes  three,  possibly  four,  times.  Finally,  the  M30230 
payoff  dynamics  are  seen  to  change  abruptly  at  the  beginning  of  1977. 

The  nature  of  the  changes  in  the  dynamics  of  these  series  is  not  pre¬ 
dictable;  we  cannot  predict  where  or  how  fast  the  dynamics  will  change 
for  any  of  then .  This  suggests  that  adaptive  Filtering  techniques  might 
be  useful  in  building  better  prediction  models  for  the  payoffs.  These 
results  also  suggest  that  we  need  to  develop  methods  which  can  adapt  to 
the  following  situations: 

(i)  slow  changes  in  parameters 

(ii)  step  changes  in  parameters 

In  the  sequel,  we  develop  an  adaptive  filter  which  can  handle  both, 
types  of  situations  by  simply  varying  a  single  scalar  parameter. 


7 . 2  Approaches  to  Adaptive  Filtering 

The  different  pcssihle  methods  of  adaptive  filtering  may  be  divided 
into  four  general  categories:  1)  Bayesian  estimation;  2)  maximum  likeli¬ 
hood;  3)  correlation  methods;  and  4)  covariance  matching. 

A  discussion  of  these  techniques  and  comparisons  between  them  have 
been  given  by  Mchra  (1972).  Of  these  four  methods,  the  maximum  likelihood 
approach  is  generally  the  most  attractive  since  it  produces  (ideally) 
consistent,  unbiased  and  efficient  estimates  for  all  parameters.  One 
drawback  of  the  maximum  likelihood  approach  is  that  numerical  solutions 
require  solving  difficult  nonlinear  programming  problems  (Gupta  and  Mehra, 
1974).  However,  it  is  also  possible  to  develop  approximation  techniques 
which  lead  to  solutions  which  may  be  found  recursively.  This  is  the 
approach  taken  in  the  sequel. 

7.3  Maximum  Likelihood  Estimation 

Let  a  denote  the  set  of  parameters  we  wish  to  estimate.  For  example, 
if  we  wish  to  simultaneously  estimate  the  matrices  $  and  K,  then 

a  =  {4>,K} 

Now  let  Y  *  {y ( 1) ,y (2) , . . . ,y(k) } ,  with  v(i)*Hx(i).  Then  the  marginal 

k 

probability  density  of  a,  given  Y  ,  is 


where 


P(a|Yk) 


P(Ykla)P(a) 

P(Yk) 


p(Yk|a)  =  p(Yk-1,y(k) | a) 

-  p(y(k)|Yk'1,a)p(Yk"1|a) 

=  p(y(k)  1  Yk_  1 ,  ct )  P  ( y  ( k- 1 )  !  vk~2  ,  rt)  .  .  .p(y(1) 


(7.5) 


(7.6) 
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Under  the  assumption  that  y(i)  is  Gaussian,  it  follows  that  p(y(i)|Y*  ,a) 

is  Gaussian  with  mean  H$x(i-l|i-l)  and  covariance  E. 

The  maximum  likelihood  estimate  can  be  obtained  by  maximizing 

L(a)  *=  log  p(a|Yk) 

k  . 

»  -%  l  [y (i)  -  H$>x(i-l|i-l]  E ly  (i)  -  H$x(i-1 1 i-1) J 

i“l 

-  Y  log|lj  +  log  p(a)  +  constants  (7.7) 


with  respect  to  a. 

In  Eq.  (7.7),  the  matrices  <!>,  E  and  the  estimates  x(i-lji-l)  are  all 
functions  of  a.  If  no  a  priori  distribution  on  a  is  given,  the  term  log  p(a) 
is  dropped.  We  will  make  this  assumption  in  the  sequel. 

The  solution  is  found  by  solving,  simultaneously,  the  first-order 
necessary  conditions 


3 MoQ  c  n  3L(a) 
3a  u’  3E 


(7.8) 


Denote  the  maximum  likelihood  estimates  by  S,  E.  Then 


oiAUJ 

3a 

-  l  is 

a  i»l 

3L(a) | 

1  =  tr{kZ-^  -  E-1  1 

3E 

a,z 


■^T.-li 


=  o 


(7.9) 


(7.10) 


fi.E 


Eq.  (7.10)  gives 


1  r  T 

2  -  ~  l  'j(i)vd)1 

K  i=l 


(7.11) 


The  remaining  problem  is  to  solve  (7.9)  for  S.  This  is  a  nonlinear 
problem  and  we  must  resort  to  some  type  of  iteration  scheme.  The  method 
which  appears  to  work  best  in  general  practice  (Gupta  and  Mehra,  1974)  is 
the  Gauss-Newton  iteration: 


a* 


r T  i-l  3L(a)T 
‘  r  3a 


a 


z 


where  Ip  is  the  Fisher  Information  matrix 


(7.12) 


(7.n) 


=  y  3v(i)T  .-1  3v ( 1 ) 

XF  /■  8a  A  3a 

l^l 

The  maximum  likelihood  parameter  identif ical ion  algorithm  may  now  be 

summarized  as  follows.  Starting  with  initial  estimates  and  1^,  com¬ 
pute 


(i)  r  = 


i=l 


a  =  a 


(ii) 


Z1  m  l  y_1  3v^> 


F  >  3a 

i=l 


3a 


a  =  a 


(iii) 


a  =  a  -  [I_]  i 


(iv)  S£+1  =  ]-  l  v(i)v(i)T 

K  i=l 


a  =  a 


vje+l 


(7.14) 


(7.15) 


(7.36) 


(7.17) 


if  ||a  -a  ||  >  £  go  to  (i),  otherwise  stop. 

This  iteration  solves  the  estimation  problem  in  a  batch  mode.  We 
will  adapt  it  to  a  more  useful  recursive  form  in  the  next  section. 


7.4  Development  of  Adaptive  Filtering  Algorithm 

In  this  section,  an  adaptive  filter  suitable  for  on-line  operation 
is  developed.  The  arguments  follow  closely  the  work  of  DuVal  (3976).  In 
adapting  the  maximum  likelihood  estimator  of  Section  7 . 1  to  adaptive  fil¬ 
tering,  several  points  must  be  kept  in  mind: 

1.  We  wish  to  make  the  adaptive  f liter  completely  recursive. 

2.  We  wish  to  discount  old  data  which  were  subject  to  dynamics 
different  from  those  of  the  present  data.  This  will  be  done  using  ace- 
weight ing  of  the  data. 

3.  We  need  to  be  aware  of  the  fact  that  we  are  attempting,  in 
reality,  to  solve  a  nonlinear  filtering  problem.  Since  the  optimal  solu¬ 
tion  cannot  be  found  in.  practice,  we  must  be  careful  to  ensure  that  the 
approximations  we  make  do  not  degrade  the  convergence  properties  of  the 
algorithm.  In  particular,  we  will  make  the  assumption  that  the  innovations 
are  linear  in  the  parameters,  when  in  fact  the  rc-lit  ionship  is  nonlinear. 

As  a  consequence,  it  is  not  a  good  idea  to  update  the  parameters  to  their 
optimal  values  at  each  sample.  Rather,  we  will  make  only  a  partial  cor¬ 
rection  to  the  parameter  estimates  at  each  sample  using  the  following 

f ormul a : 


«  V 


a(k+l)  -  a(k)  +  Bf.Kk)  -a(k)] 


(7.18) 


where  Ci(k)  is  th‘e  actual  parameter  vector  utilized  in  the  filter  and 
S(k)  is  the  "optimal"  value  computed  in  the  adaptation  process. 

A.  The  innovations  covariance  matrix  7.  is  computed  independently  of 
the  identification  of  the  parameters,  We  may  therefore  use  any  constant 
weighting  matrix  W  in  place  of  7.  in  the  cost  function  L(a)  and  eliminate 
the  need  to  identify  T.  on-line.  This  may  also  lead  to  more  robust  adap¬ 
tive  filters  since  increased  values  of  v(i)  are  compensated  in  L(a)  by 
increased  values  of  7.  By  using  a  constant  matrix  V,  we  are  exerting  more 
positive  control  in  keeping  the  innovations  small. 

With  these  points  in  mind,  we  now  turn  to  the  development  of  the 
adaptive  filter.  The  cost  function  we  will  use  is 

k  .  .  t  l 

J(k)  -  h  l  Y  v(i)1w"1v(i)  (7.19) 

i=l 


where  y  is  a  scalar  age-weighting  factor  used  to  discount  older  data  in 
a  gradual  fashion.  We  will  made  several  assumptions: 

(1)  The  filter  has  reached  a  statistical  steady  state  so  that  the 
optimal  gains  are  constant. 

(2)  The  innovations  are  approximately  linear  functions  of  the 
parameters  (the  elements  of  i  and  K) . 

We  now  make  one  important  additional  assumption,  namely,  that  the 
gain  K,  as  determined  in  the  state  space  modeling  program,  remains  close 
to  optimum  for  the  duration  of  the  time  series  of  interest.  The  PJT! 
payoff  data  of  Figures  7.1 -7.6  suggest  that  greater  changes  are  expected 
in  $  than  in  K  in  most  cases.  For  this  reason,  the  following  develop¬ 
ment  will  be  based  on  adapting  the  transition  matrix  0,  but  using  a  con¬ 
stant  gain  matrix  K.  This  is  equivalent  to  saying  that  following  the 
trends  in  the  data  will  be  more  important  than  estimating  changes  in  its 
rras  variation  about  the  trend. 

There  are  several  possible  approaches  to  on-line  adaptation  of  t. 

The  simplest  approach  is  to  simply  adapt  each  component  independents , 
thus  eliminating  a  nigh-order  matrix  inversion.  However,  this  approach 
neglects  the  interactions  between  the  elements  of  h>,  which  may  be  quite 
significant.  If  all  components  are  adapted  simultaneously,  a  matrix  of 
2  2 

dimension  n  * n  must  be  inverted.  A  different  approach  has  been  taken 
by  DuVal  and  represents  a  compromise  between  these  two  extremes.  This 
approach  is  based  on  adapting  the  components  of  one  column  at  a  time. 

The  rationale  for  this  approach  is  that  each  column  of  $  acts  on  a  single 
component  of  the  state  vector,  so  that  the  column  elements  will  be  more 
highly  correlated  with  each  other  than  with  the  elements  of  other  columns. 

th 

Let  <fi  be  the  i  column  of  $;  i.e., 

#  *  !  4>2  !  •  ••  4>n] 

Then,  using  the  relations, 


A  6 


x  (, !  1  i  -  1 )  t  >.  •  i  -  1  '  i  -  1  > 
j(  i )  -=  •  v  (  i  )  -  H>.  i  i  :  -  1  > 

We  ll.l'.'i' 

,  v  •  ’ 

H  ' 

' '  ] 

and 

3  x  (i  1  i  -  ?  1 

:■*: .  .-V. 

j  j 

? 

n  - 

3: . 

i 

=  ii.fi-’  i-i)  4  : 

where  x. (i-1  i-1)  is  the  j  component  of  x(i-li-l).  Now  using 
x ( i - 1  !  i-1)  =  x ( i  —  1 ! i-2)  +  K.(i-l) 


[ :  i  f  i  - 1 :  i  - : )  ] 
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we  have 

3x( i-1 1 i-1 )  =  ?x( i-1 | i-2)  3v(i-i) 

3$.  30-  30. 

J  J  J 

Combining  these  results  and  defining  the  sensitivity  function 

G  (i)  . 
j  30j 

gives  the  recursion 

G  .  (  i)  =  lx  .  ( i-1 ! i-1)  +  0(I-KH)G . (i-1) 
i  J  J 


Now  define 

S  ( i)  -  =  -HG.(i)  ( 

j  30^  j 

Using  these  results,  we  can  compute  the  gradients  of  the  cost  tunctie 


r  (k)  -  -  y  vk'1s  (i)V'v(i) 

1  ^  i.'i  1 


/ 


A .  (k) 
J 


(7.23) 


2  k 

-3vJ~  =  V  Yk_1s.(i)’1w'1s.(i) 

°V?J  i-1  J  J 


Then  by  analogy  to  (7.14)  -(7.17),  the  maximum  likelihood  estimates  of 
are  found  via  the  iteration 


„£+ 1  , J  f  -If 

(k)  =  <t*(k)  -  [A.(k)]  .  ,(k) 


(7.24) 


where 


rj(k)  -  r  (k) 


^  *  ♦  ( k) 


A  (k)  *  A  (k) 


„2 

4,  -  i  (k) 
J  J 


This  iteration  corresponds  to  a  batch  processor  using  the  data  Y  .  We 
wish  to  convert  it  to  a  recursive  form.  We  start  by  noting  that 


r  (k)  =  >r  (k-l)  +  Sj(k)Tw'1v(k)  (7.25) 

Aj (k)  =  Yr.(k-l)  +  Sj(k)TS~1S.(k)  (7.26) 

We  will  make  the  additional  assumption  that  only  one  iteration  of  the 
maximum  likelihood  equations  will  be  made  at  each  tire  step.  This  appears 
to  be  a  reasonable  issumpt  ion  since  we  do  net  expect  the  matrix  4  to 
undergo  a  large  lump  ,;t  a  single  time  but  rather,  that  changes  will  occur 

over  at  least  several  successive  time  stops.  Fven  if  larcc  changes  did 

occur  at  only  a  single  step,  it  would  take  several  additional  measure¬ 
ments  of  v  to  estimate  the  change.  This  assumption  is  also  in  keeping 
with  the  phi  i  .■son',  of  "cmticus"  adapt. it  ion  t  •  minimize  the  effects  or 
unmode  led  uncertainties.  Witn  this  assur.pt  i  'n  the  adaptation  equations 
(7.18)  and  (7.24)  become 

$.(k)  =  $.( k-n  -  *..(k)"1:.(k)  (7.27) 

j  J  J  J 

4, (k+1 )  =  ;  .  f  k)  +  r [*  .  (k)  -  :  .  (k)  ]  (7.23) 

j  1  J  J 

In  order  to  analyze  this  algorithm  we  first  consider  its  performance  under 
average  steadv-stire  i  ^nd  it  ions. 

Steady-St  it  e  Conditions 

When  the  adaptor  has  converged,  the  following  conditions  hold,  on  the 
average  (c  f .  (7.24)): 
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Efr  (k)j  =  o 


(7.29) 


l  E[S.(i)W  V(i)]  =  0 


(7.30) 


We  wish  to  investigate  the  conditions  under  which  (7.29)  holds.  Now  use 


S  (i)  =  -HG.(i) 

J  3 

V(i)  =  -He(i|i-1) 


(7.31) 


where 


e(i | i-1)  =  x(i | i-1)  -  x(i) 


(7.32) 


Then  (7.28)  becomes 


J  E[G.(i)THTW~1He(i|i-l)]  =  0 


Assume,  for  simplicity,  that  y  is  a  scalar.  Then  a  sufficient  condition 
for  (7.30)  to  hold  is 


E[e(i |i-l)G.(i)T]  -  0  Vi 


(7.33) 


e(i+l|i)  =  (I-KH)e(ij i-1)  -  w(i+l) 


(7.34) 


t  =  C(I-KH) 


G . ( i+1 )  =  Ix.(ili)  +  ?G.(i) 

J  J  J 

e(i+l|i)  =  ?e(i|i-l)  -  v(i+l) 


Def ine 


Qj(i)  =  F.[c(i|  i-l)G.(i) 


QjU+l)  =  F.{[$c(i|  i-1)  -  w(i+l]|Ix  (i!i)  +  G!(i)?T]} 

=  ?0.(i)TT  -K|w(i  +  l)x  ,  (i!  i)l  -  F[w(i  +  l)G.(i)T]?T  +  4F.[e(i  \  i-l)x  (i  I  i) 


The  terras  involving  w(i+!)  are  zero  si nee  w( i+1 )  is  assumed  independent 
of  the  past.  Thus 


Qj (i+1) 


CQ.Ci)?1  + 


'  F.  [  e  (  i  !  i  - 1 )  x  .  (  i  '  i )  ] 
J 


(7.35) 


If  the  filter  has  converged  to  a  solution  C1  after  r  time  steps,  we  wish 
to  have 


Qj (i)  =  0;  i =  r,r+l - - 

This  will  be  satisfied  if 


E[e(i | i-l)x(i j  i)T]  -  0;  i  =  r,r+l,.... 
This  condition  is  equivalent  to 


E[e(i|i-l)x(i| i-l)T]  =  E fe(i ! i-1) e(i | i-1 )T]HTKT  =  P’HKT 

Under  optimal  (Kalman)  filtering  the  left-hand  side  is  zero  since  the  error 
and  estimate  are  orthogonal.  Thus,  the  algorithm  will  not  converge,  on 
the  average,  to  a  Kalman  filter.  This  failure  may  be  traced  to  the  fact 
that  the  matrix  I  was  not  included  in  the  cost.  A  simple  modification 
leads  to  an  algorithm  which  does  converge,  on  the  average,  to  the  Kalman 
filter,  if  it  converges  at  all.  The  modification  is  to  use  another  re¬ 
cursion  for  G^(i): 

G^i+l)  =  (i |  i-1)  +  $(k)[I-KK]G  (i)  (7.36) 

This  form  yields  an  "unbiased"  adapter,  in  the  sense  that  (7.33)  is 
satisfied  for  i  2r.  However,  it  does  not  necessarily  yield  a  minimum 
variance  estimate  of  C>. 

We  now  consider  another  approximation  we  have  used  thus  far,  namely, 
that  the  value  of  0  is  constant  for  all  time  steps  since  we  have  assumed 
batch  processing  of  the  data. 

Accounting  for  Varying  Reference  Transition  Matrices 

The  adaptation  equation  for  Cv  (7.27)  is  based  on  the  assumption  that 

is  fixed  for  all  time  steps.  In  practice,  this  will  not  be  true  and 

we  need  to  account  for  the  fact  that  0.  is  time  varying.  We  may  do  this 
in  the  following  manner.  Let  ^ 


r  k-i  . , . T  - 1 
I  y  v(i)  w  v(i) 

i=l 


Vk> 


be  the  cost  associated  with  the  sequence  Cm  (1)  (2)  , 


,Ch  (k)  .  Viewing 


0 


tiiis  as  a  reference  sequence  we  can  expand  the  cost  for  using  an  estimate 
(J>.(k)  as  a  Taylor  series  to  second  order: 


J(i.(k))  =  J-+  l  Yk_1[$  .(k)  -  ,‘(k)]TS(i)TW  V'i) 
J  U  i=l  J 


°j(i) 


+  I  Yk_1i$.(k)  -<?(k)]’1S(i)1W_iS(i)[3.(k)  -$.(k)] 


T  T  -1 

1  C  (  i  \  L  1  X  ' 


i=l 


The  minimizing  value  $  (k)  satisfies: 


3J(S . (k) ) 


3<Mk) 


k 

I 

i=l 


J - =  l  yK  ‘S(1)TK  h(i) 


V‘> 


-  k-i  T 
+  )  y  S(i) V  JS(i) 

i=l 


k/i) 


“V • ( i) ]  =  0 


Similarly,  for  the  estimate  ^(k-1)  we  have 


k-i  .  ,  . 

I  Y  S(i)W-iv(i) 

i=l 


k-1 


0_j(i) 


+  l  Yk'i~1S(i)V1S(i) 

i=l 


<4> . (i) 
J 


[^j  (k-1)  -  4>j  (i)  ]  =  0 


These  may  be  converted,  using  (7.22)  arid  (7.23),  into  the  form 

k 

r.(k)  +  A.(k)$,(k)  -  l  Y^'^ijV^DMi) 


J 


i=l 


k-1 


I’.(k-l)  +  A.(k-l)Mk-l)  =  L  Yk_1  1S(i)V1S  (i)4>.(  i) 
J  J  J  i=l  J 


Combining  these  yields 


Fj(k)  “  Yrj(k_1)  +  "  YAj (k-l)$j (k-1)  =  S(k)  W  S(k)0j(k) 
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Now  using  (7.25)  and  (7.26)  are  rearranging  gives 


$j(k)  =  $j(k-l)  -  Aj(k)“1S(k)V1{v(k) 

-  S(k)[<|»j(k)  -  $j(k-l)] }  (7.37) 

This  equation  is  valid  for  time-varying  reference  values  of  <J>  . 

This  completes  the  major  development  of  the  adaptive  filter.  In 
summary,  the  adaptation  equations  are  (7.28)  and  (7.37),  while  A  is  up¬ 
dated  using  (7.26).  Note  from  (7.37)  that  an  n  *  n  matrix  inversion  is 
required  to  compute  $^(k).  If  n  is  large,  this  can  cause  numerical  prob¬ 
lems.  This  problem  car.  be  alleviated  in  most  cases  if  m,  the  dimension 
of  y,  is  less  than  n  by  using  an  alternate  form  that  only  requires  in¬ 
verting  an  m x  m  matrix.  This  may  be  done  as  follows. 

Simplification  for  m*n 

By  using  the  matrix  inversion  lemma  (Bryson  and  Ho,  1969)  and  (7.26), 
we  can  write 


Aj (k)  1  =  i  [1-D  (k)Sj(k)]A  (k-1)  1 


where 


D . (k)  =  A  (k-l)_1S.(k)TM  (k)  1 

J  j  J  J 

Mj(k)  =  Sj(k)Aj(k-l)'1S.(k)T  +  yW 


Another  form  for  D^(k)  is 


Dj (k)  =  Aj (k)  1Sj(k)TW_1 


(7.38) 


(7.39) 

(7.40) 


(7.41) 


which  gives,  for  (7,37), 


$j(k)  -  $  (k-1)  -  Dj(k){v(k)  -S(k)[<5.(k) 


Note  that  A^(k)  can  be  computed  recursively  using 
inverting  only  the  m * m  matrix  Mj(k). 

We  remark  that  the  equation  for  updating  $  is 
Kalman  filter  with  D.(k)  the  Kalman  gain  matrix  and 


(k-1) ] }  (7.42) 

(7.38)  -  (7.40)  by 

in  the  form  of  a 


v(k)  -  S(k)[*  (k)  -$j(k-l)] 


the  innovations  process.  The  matrix  A . ( k)  is  the  covariance  matrix  of 
estimation  errors  of  ^ 

Summary  of Adapt ive  Filtering  Equations 

The  preceding  development  is  summarized  in  Table  7.1,  which  present 
the  final  form  of  the  adaptive  filtering  algorithm.  In  the  table, 

XjtD-Ajtl)-1. 


'i  < 


Table  7.1:  Adaptive  Filtering  Algorithm 


Initial 

conditions: 


Filter: 


Cost: 

A 


Adaptor 

Gain 

Propagation: 


Adaptor: 


Sensitivity 
Pro pa gat  ion: 


Propagate 

State 

Estimate: 


J(0)  =  0,  S  (1)  =  0,  Gj  ( 1)  =  0, 

x(ljO)  =  «(0)x(0|0),  ♦  (1),  $.  (0) 

'v(i)  =  y(i)  -  Kx(iji-l) 
x( i | i)  =  x(iji-l)  +  Kv(i) 

J(i)  =  yJ(i-l)  +  v(i)TW-1v(i) 
j  =  1 

Mj  ( i)  =  S.(i)A.(i-l)S.(i)T  +  yW 

-  DjCi)  =  1. (i-l)S.( i)TM  (i) _1 

A.(i)  =  i  [I-D.(i)Sj(i)]Aj(i-l) 

(i)  =  Ij(i-l)  -D.(i){v(i)  -  SjCi)  tdjCi)  -  $  (i-1)  3 } 
,<Mi+i)  =  4>  (i)  +  et$.(i)  - <*».(!) 3 

J  J  J  J 

|"Gj  (i+l)  =  IXj  ( i  I  i-1)  +4>(i)  [I  -  KH]Gj(i) 

(Sj(i+1)  =  “HGj (i+l) 

j  =  j+1 

if  j  n+1,  go  to  A 

'$(i+D  *  [ ( i+l)  |<>2(i+l)  |  ...  |4>n(i+l)] 

,x(i+l  | i)  =  4>(i+l)x(iji) 

5.'* 


8.  ADAPTIVE  FILTERING  OE  PJM  PAYOFF  DATA 


8.1  Nature  of  the  Experiment 

In  order  to  test  the  adaptive  filter  developed  in  the  earlier  sec¬ 
tions  of  this  report  on  actual  PJM  payoff  data,  a  number  of  experiments 
were  run.  In  these  experiments,  the  filter  was  exercised  on  data  that 
exhibited  what,  might  be  thought  of  as  "policy"  changes;  that  is,  those 
PJM  payoff  series  that  showed  a  behavior  pattern  for  a  reasonable  length 
of  time  and  then  a  change.  This  property  of  reasonably  constant  behavior 
over  a  period  of  time  of  either  the  original  series  or  a  series  derived 
from  the  original  by  some  differencing  operation  is  important  to  the  cor¬ 
rect  operation  of  the  adaptive  filter. 

The  adaptive  filter  has,  in  some  sense,  properties  similar  to  that 
of  a  phase  locked  loop.  That  is,  there  will  exist  a  bandwidth  in  the 
rate  of  signal  change  over  which  it  will  function  properly.  Exceeding 
this  bandwidth  will  cause  the  filter  to  lose  the  "signal"  (in  this  case 
the  state  transition  matrix)  and  perform  poorly.  Like  the  loon  filter 
in  a  phase  locked  loop,  the  adaptive  filter  has  two  parameters  that  con¬ 
trol  the  bandwidth  over  which  it  will  correctly  track  the  signal.  The 
first  parameter  is  y,  the  age  weighting  parameter.  This  parameter  is 
similar  to  the  settling  time  of  the  loop  filter.  Too  long  a  time  con¬ 
stant  (y  high)  will  cause  the  filter  to  be  sluggish  in  reacting  to  last 
change  in  the  transition  matrix.  Too  short  a  time  constant  (y  low)  will 
cause  the  filter  to  respond  only  co  very  recent  data.  The  s*-ci nd  para¬ 
meter  is  £,  the  state  transition  matrix  si"V  rate  parameter .  f  should 
be  set  to  a  low  value  for  highly  random  data  and  to  a  high  value  for 
smoothly  varying  data.  This  parameter  is  similar  to  the  damp  in  •  of  the 
phase-lock  filter,  in  that  too  high  a  value  will  cause  the  filur  to 
overreact  to  a  change  and  overshoot,  bounce  or  even  oscillate.  >o 
a  value  will  cause  the  filter  to  adapt  too  slowly  to  a  change  m  the 
inputs . 

Ideally,  these  two  parameters  should  be  varied  on-line  in  re-p* 
to  the  local  behavior  of  the  signal.  During  periods  o:  . 

should  be  relatively  low  and  t  relatively  high  in  order  re  tra  •  t 
change.  During  periods  of  constant  behavior,  the  rovr-o 
to  filter  out  noise.  The  adaptive  filter  thus  no.  a  within  it—  t 
lem  of  adapting  its  own  parameters.  The  experiments  el  this 
a  scheme  for  this  which  seems  to  give  reasonable  results.  Ibis  - 

will  be  discussed  later  in  this  section. 

In  order  to  reduce  the  bandwidth  of  the  change  in  the  state  tr.-wi 
matrix  and  reduce  variations  about  underlying  trends.  ,  xrer  im.  r.t  -  r 
section  used  right-justified  or  causal  moving  averages  r  f  the  F  'V  pa  .  - 
off  data.  The  desire  to  reduce  the  bandwidth  was  motivated  t>v  two  fa*  t>  is 
The  first  factor  was  that  the  payoff  series  data  were  quantized  or  per¬ 
haps  rounded  to  the  nearest  integral  value.  Thus,  if  the  actual  s«.;ws 
was  100.9,  100,  98.9,...,  the  quantized  data  available  would  have  been 
100,  100,  98.  This  results  in  a  much  higher  bandwidth  than  was  realis¬ 
tically  expected  in  the  data,  with  a  large  number  of  step  changes.  The 
second  reason  was  to  observe  the  response  of  the  y  and  p  adaptation 


algorithm  to  changes  that  could  be  more  easily  pinpointed. 


8.2  Determining  y  and  0 

There  exist  a  number  of  approaches  for  determining  Y  and  6.  The 
first  is  to  assume  that  the  two  variables  are  constant  for  the  series. 

The  values  of  y  and  0  that  may  be  used  can  be  found  by  evaluating  the 
filter  performance  on  some  cost  criteria  for  a  historical  dataset.  A 
minimum  cost  point  can  be  found  and  values  of  y  and  6  used  for  the  future 
filtering  problem.  This  approach  has  an  obvious  advantage  and  several 
disadvantages.  The  advantage  is  that  it  is  probably  more  inexpensive  to 
determine  the  values  only  once  rather  than  determining  them  on-line.  The 
disadvantage  is  that  this  approach  is  most  likely  to  be  very  suboptimal. 

The  optimum  values  of  y  and  0  are  most  likely  time  varying  quantities, 
so  a  single  value  will  give  locally  poor  performance.  Either  the  filter 
will  be  too  sluggish  or  else  it  will  overshoot  when  viewed  on  a  local 
level.  Further,  even  if  the  optimum  values  of  y  and  0  are  constant  over 
the  historical  data,  there  is  no  guarantee  that  they  will  be  so  in  the 
future. 

A  second  approach  will  be  to  filter  for  y  and  0  in  some  manner.  To 
do  this,  we  must  construct  some  sort  of  model  for  the  behavior  of  y  and  0. 

A  heurist ically  reasonable  model  for  these  parameters  would  be  that  they 
would  be  produced  by  a  persistence  plant.  That  is,  that  the  values  of 
y  and  0  are  as  likely  to  increase  with  tine  as  they  are  to  decrease.  This 
assumption  is  violated  at  the  boundaries  zero  and  one,  but  will  be  accepted 
here.  We  thus  will  assume  the  model: 


Y(t+1)~ 

i  0 

Y(t) 

nx  ( t) 

s 

+ 

8 ( t+1 ) 

0  1 
—  — 

_B(t)_ 

n2(t) 

where  n(0  is  a  white  noise  vector  with  zero  mean  and  covariance  matrix  Q. 
For  our  purposes,  it  will  suffice  to  assume  that  Q  is  0‘I  for  some  a. 

This  basically  states  that  y  and  8  move  independently  of  each  other  with 
increments  of  equal  probability. 

The  total  model  is  basically  one  of  two-dimensional  Brownian  motion. 
Again,  this  will  be  violated  at  the  boundaries,  but  is  not  totally  un¬ 
reasonable  in  the  interior. 

The  next  tiling  that  must  be  assumed  in  the  filter  is  a  cost  function. 
Since  our  ultimate  desire  is  to  minimize  the  error  in  the  state  variable 
predictions,  a  quadratic  form  on  the  one-step  prediction  innovation  will 
be  reasonable. 

Final lv ,  it  is  necessary  to  model  the  transfer  function  from  y  and  S 
to  the  predictions,  and  the  additive  noise  on  this  transfer  function.  The 
transfer  function  itself  is  quite  trivial,  being  the  adaptive  filter  it¬ 
self.  That  is,  all  else  being  constant,  the  prediction  made  by  the  adap¬ 
tive  filter  is  a  function  of  y  and  £.  The  noise,  however,  is  not  so 
straightforward.  First,  like  the  plant  noise,  it  is  not  a  Gaussian  vari¬ 
able.  Secondly,  its  variance  is  process  noise  dependent.  That  is,  it 
depends  on  the  plant  and  additive  noises  of  the  observed  series,  which  in 


general  are  unknown.  If  wo  assume  an  a  priori  "signal -to-no i se"  ratio 
of  tiie  y  and  6  plant  to  the  additive  noise  in  the  adaptive  1  liter,  we 
may  make  some  headway.  Call  this  parameter  a(i). 

Given  these  assumptions,  it  is  possible  to  design  a  filter  that 
attempts  to  track  y  and  6.  The  algorithm  is  basically  as  follows: 

1.  Assuming  a  value  for  y(i)  and  £(i),  perform  a  prediction  of 
x(i)  (the  state  variables)  for  time  i+1,  giving  x'(i-t-l). 

2.  Observing  y(i+l),  calculate-  the  actual  cost  function  in¬ 
curred  . 

3.  Varying  y(i)  and  B(i)  within  a  radius  a,  perform  step  1  as 
if  that  value  had  been  used  to  predict  x(i+l). 

4.  Evaluate  the  cost  function  of  step  2  for  these  predictions. 

5.  Select  as  y(i+l)  and  B(i+1)  the  minimum  step  4  cost  a  and  &. 

6.  Go  to  step  1  for  time  i+1. 

This  algorithm  is  motivated  in  terms  of  our  earlier  discussion  as 
follows:  step  6  is  the  prediction  step  of  a  Kalman  filter.  Steps  1  and 

3  are  the  modulation  stops  in  an  extended  Kalman  filter.  Steps  j  and 

4  taken  together  find  the  direction  of  steepest  descent  of  the  cost 
function.  This  may  be  viewed  as  the  sensitivity  r.atr.x  computation  of 
the  extended  Kalman  filter.  Step  5  in  combination  with  step  3  is  an  up¬ 
date  step  in  the  filter.  Although  still  somewhat  ad  hoc,  this  algorithm 
contains  sufficient  motivation  to  make  it  reasonable  in  practice. 

8 . 3  Result s  and  Discussion 

The  adaptive  filter  was  run  on  a  number  of  P.1M  payoff  series.  A 
list  of  some  of  the  series  with  the  prediction  error  summary  of  the 
adaptive  filter  and  persistence  predictor  errors  tor  1,  3  and  1 2 -month 
predictions  are  given  in  Table  8.1.  Figures  8.1  -8.8,  8.9-8.16,  and 
8.17-8.24  show  the  1 -month,  3 -month  and  12-month  predi et ions  with  ob¬ 
served  data  respectively.  Figures  8.25-8.32  show  the  values  of  y  and  f 
determined  by  the  program . 

The  performance  of  the  adaptive  filter's  1-  and  3-month  predict  ierc 
are  quite  good  when  compared  to  the  persist  :<■  predictor.  The  estimates 
are  generally  unbiased  and  the  error  covariance  less  thin  the  persistence 
predictor.  Examining  the  plots,  we  note  an  overshoot  or  undershoot  at 
those  times  that  the  system  changes,  but  this  is  an  expected  event. 

The  performance  of  the  filter  in  its  12-month  predictions  is,  at 
best,  poor.  While  still  relatively  unbiased,  the  error  covariance  is 
large.  Examination  of  the  plots,  in  particular  that  of  F46330,  shows  the 
cause.  Basically,  the  filter  is  usually  being  asked  to  predict  further 
into  the  future  than  the  mean  time  between  policy  changes.  In  the  worst 
case,  its  predictions  become  180°  out  of  phase  with  reality. 

The  plots  of  y  and  S  show  that  the  algorithm  is  indeed  changing  thes 
parameters  on  the  basis  of  changes  in  the  behavior  of  the  series.  For 
the  majority  of  the  series,  however,  the  parameters  are  being  modified 
in  a  counter-intuitive  manner.  At  points  of  change  in  the  series,  y 


increases  and  B  decreases.  During  periods  of  constant  behavior,  y  de¬ 
creases  and  6  increases.  For  this  reason,  the  algorithm  previously 
presented  may  have  to  be  modified  or  superseded.  It  should  be  noted, 
however,  that  the  algorithm  yields  results  that  are  better  than  single 
choices  of  y  and  8-  Table  8.2  documents  the  performance  of  the  adaptive 
filter  in  the  varying  y  and  B  mode  versus  several  choices  of  a  constant 
y  and  8.  The  varying  mode  performs  better. 

The  conclusion  that  may  be  drawn  from  these  experiments  is  that  the 
adaptive  filter  performs  in  a  superior  fashion  to  the  persistence  pre¬ 
dictor  for  short  and  medium  range  predictions.  For  long  range  predic¬ 
tions  beyond  the  mean  time  to  a  policv  change,  the  filtir  performs  in  a 
manner  inferior  to  a  simple  persistence  predictor.  Finally,  the  algorithm 
that  varies  y  and  8  gives  better  performance  than  a  constant  y  and  8,  but 
is  probably  suboptimum. 
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Figure  8.9.  Adaptive  Filter  3-Month  Prediction  of  F42333 
1  =  Observed  Data,  2  =  3-Month  Prediction 
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Figure  8.10.  Adaptive  Filter  3-Menth  i'le.iict; 
1  =  Observed  Data,  2  =  3-Month  Prediction 
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1  =  Observed  Data,  2  =  3-Month  Prediction 
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9.  CONCLUSIONS  AND  RECOMMENDATIONS 


This  study  has  revealed  certain  characteristics  of  the  PJM  payoffs 
that  can  be  exploited  in  developing  efficient  prediction  schemes.  First, 
series  within  particular  groups  tend  to  move  together.  For  example,  the 
E80F  series  are  highly  correlated  as  a  group,  but  tend  to  be  uncorrelated 
with  other  series.  Series  in  the  E80F  group  are  not  highly  correlated  with 
series  within  the  E80M  group.  This  may  indicate  that  the  variable  fill 
component  dominates  for  certain  groups  since,  for  example,  all  E80F  jobs 
are  competing  for  the  same  small  pool  of  recruits.  Similar  behavior  was 
seen  for  the  A80M  group.  The  female  low  skill  series  show  a  greater  ten¬ 
dency  to  move  in  a  correlated  fashion  with  members  of  other  female  low 
skill  groups.  The  male  series  tend  to  move  together  as  a  group  more  than 
the  female  series.  However,  the  female  and  male  series  tend  to  move  in¬ 
dependently.  These  tendencies  could  be  used  to  reduce  the  number  and 
complexity  of  prediction  models.  For  example,  a  single  model  may  be  used 
to  represent  an  entire  group.  Many  of  the  series  within  that  group  could 
perhaps  be  modeled  with  that  model.  Series  which  differ  significantly 
could  be  modeled  independently  or  models  of  their  difference  from  the 
group  model  could  be  constructed. 

A  methodology  was  suggested  for  modeling  the  PJM  time  series,  based 
on  a  multivariate  state  space  representation  in  a  Markovian  setting.  A 
powerful  approach  to  model  structure  determination,  based  on  recent  re¬ 
sults  in  stochastic  realization  theory,  was  discussed.  An  algorithm  based 
on  this  theory  was  utilized  to  generate  state  vector  models  for  a  selected 
number  of  PJM  series.  The  model  was  in  the  form  of  a  time-invariant  Kal¬ 
man  filter/predictor.  Prediction  of  the  series  was  found  to  be  adequate 
in  some  cases  and  poor  in  others.  The  poor  results  were  almost  invariably 
caused  by  shifts  in  the  nature  of  the  time  series.  The  implication  from 
a  modeling  point  of  view  is  that  the  parameters  of  the  state  space  models 
change  in  an  unpredictable  manner  and  time-invariant  models  are  not  ade¬ 
quate  under  such  conditions. 

In  order  to  remedy  this  problem,  an  adaptive'  filtering  -technique  W3S 
developed.  The  parameters  of  a  Kalman  f il ter ,/predic tor  of  fixed  structure 
were  estimated  recursively  using  an  approximate  maximum-likelihood  approach. 
Based  on  an  analysis  of  the  FJM  payoff  data,  it  was  concluded  that  only 
the  transition  matrix  needed  to  be  reestimated;  the  Kalman  gain  was  assumed 
to  be  fixed.  An  extended  Kalman  filter  was  also  considered  for  this 
parameter  estimation  problem  but  was  discarded  since,  comparatively,  it 
is  less  robust,  less  accurate  and  more  complex. 

Detailed  numerical  tests  on  PJM  payoff  data  were  performed.  Compari¬ 
son  of  prediction  error  statistics  was  made  between  the  adaptive  filter/ 
predictor  and  a  pure  persistence  predictor.  The  adaptive  filter  was 
found  to  give  substantially  better  results.  Additional  tests  were  run 
using  data  generated  from  known  stochastic  dynamical  models.  Tradeoff 
studies  demonstrated  the  robustness  of  the  adaptive  filter  and  qualitative 
bounds  on  adaptation  parameters  in  order  to  maintain  stability  of  the 
adaptation  process. 

Further  development  of  the  adaptive  filter  should  be  undertaken. 

More  systematic  techniques  for  varying  the  adaptation  parameters  on  line 
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should  be  developed.  In  particular,  y  should  be  a  function  of  the  smooth¬ 
ness  of  the  estimated  parameters.  The  Kalman  gain  should  be  adapted  sim¬ 
ultaneously  with  the  transition  matrix,  being  careful  that  their  (nonlinear) 
interaction  does  not  degrade  stability  properties  of  the  adaptor.  The 
possibility  of  adapting  all  of  the  elements  of  <{>  simultaneously  should  be 
explored.  The  effect  of  using  more  that  one  iteration  per  time  step  should 
be  examined.  Comparisons  with  several  other  approaches,  such  as  sto¬ 
chastic  approximation,  should  be  made.  An  extension  to  include  prior 
information  (size  limitations  on  e.g.)  should  be  made,  possibly  using 
a  Bayesian  formulation. 

Another  extension  which  should  be  explored  is  the  use  of  disturbance 
models.  For  a  model  of  the  form 


x(i+l)  =  4>x(i)  +  n(i+l) 

where  n  is  white  noise,  we  may  add  a  disturbance  d  to  give 
x(i+l)  =  4>x(i)  +  n(i+l)  +  d(i+l) 

The  disturbance  may  be  modeled  as  an  unknown  constant,  or  may  be  slowly 
varying.  A  possible  model  is  the  first-order  Markov  process 

d(i+l)  =  Ad(i)  +  v(i+l) 

with  v(i)  a  white  noise  process.  Using  an  augmented  state 
x(i) 

x  (i)  - 

d(i) 

this  formulation  may  be  handled  by  the  general  theory  given  in  Chapters 
4,  5  and  7  and  Appendix  C.  As  a  simple  example,  a  disturbance  model  was 
used  for  prediction  of  the  12-raonth  moving  average  payoff  series  F42333. 
The  model  u^ed  was 

x(i+l)  =  x(i)  +  n(i+l)  +  d(i+l) 

d(i+l)  -  |  d(i)  +  v(i+l) 


The  Kalman  gains  were  set  to  2/3  for  both  x  and  d.  The  results  are  shown 
in  Figure  9.1  and  indicate  that  the  disturbance  filter  gives  much  better 
performance  than  any  first-order  stationary  model,  due  to  the  piecewise¬ 
stationary  trends  on  the  data. 
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Figure  9.1.  Disturbance  Filter  Applied  to  Series  F42333 
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Figure  A. 1.  Plot  of  Series  F30230 
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Figure  A. 2.  Plot  of  Series  M30230 
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Figure  A. 3.  Plot  of  Series  F67231 
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Figure  A. A.  Plot  of  Series  M67231 
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Figure  A. 5.  Plot  of  Series  F46330 
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Figure  A. 6.  Plot  of  Series  F46230 
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Figure  A. 7.  Plot  of  Series  F20430 
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Figure  A. 8.  Plot  of  Series  F54130 
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Figure  A. 9.  Plot  of  Series  TSK287 
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Figure  A. 10.  Plot  of  Series  F43130 
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Figure  A. 11.  Plot  of  Series  F42732 
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Figure  A. 12.  Plot  of  Series  F27131 
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Figure  A. 13.  Plot  of  Series  F42333 
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Figure  A. 14.  Plot  of  Series  F23132 
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Figure  A. 15.  Plot  of  Series  K23132 

in 


*  ii ' 


3  MONTH  MOVING  AVERAGE  OF  PAYOFF 


F30230 

A=AVERAGE 

165.0+ 


163.5+ 


A 


AA 


162.0+ 


A  A 


A 


A  A 

A 

A  A 


A 


A 


A 


160.5+ 


A  A 


A 

A 

A  A 


AA 


A  AAA 
A 

A 


A 

A  A 

A  A  A  A 


A 


AA 


A 

A  A 


159.0+ 


A 


A 


A 


AA 


A  A 


A 

A 


157.5+ 


A 


A 


A 


156.0+  A 

- + - + - + - + - + - 

MAM JJASONDJFMAMJJASONDJFMAMJJASOND JFMAMJ JASONDJFMAMJJASOND JFMA 
1973  1974  1975  1976  1977 


figure  A.  10.  Plot  of  3 --Month  Moving  Avcrnge  of  F30230 
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Figure  A. 17. 


Floe  of  ''•-Month  Movin'.’,  Average  of  M30230 
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Figure  A.  18.  Plot  of  3-Month  Moving  Average  of  F67231 
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Figure  A.  19.  Plot  of  3-Mor.th  Moving  Average  of  >167231 
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Figure  A. 20. 


Plot  of  3-Month  Moving  Average-  of  F46330 
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Figure  A. 21.  Plot  of  3-Month  Moving  Avernge  of  F46230 
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Figure  A. 22.  Plot  of  3-Month  Moving  Average  of  F20430 
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Figure  A. 23.  Plot  of  3-Month  Moving  Average  of  F54130 
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Figure  A.  24.  Plot  of  '3-Month  Moving  Average  of  TSK287 
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Figure  A. 25.  Plot  of  3-Month  Moving  Average  of  F43130 
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Figure  A. 26.  Plot  of  3-Month  Moving  Average  of  F42732 
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Figure  A. 27. 


Plot  of  V Me nth  Moving  Average  of  F27131 
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Figure  A. 28.  Plot  of  3-Month  Moving  Average  of  F42333 
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Figure  A. 29.  Plot  of  3-Month  Moving  Aver.ige  of  F23I32 
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Figure  A. 30. 
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Figure  A. 31.  Plot  of  12-Month  Moving  Average  of  F30230 
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Figure  A. 33.  Plot  of  12-Month  Moving  Average  of  F67231 
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Figure  A. 34.  Plo  of  12-Month  Moving  Average  of  M67231 
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Figure  A. 35.  Plot  of  12-Month  Moving  Average  of  F46330 
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Figure  A. 36.  Plot  of  12-Month  Moving  Average  of  F46230 
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Figure  A. 37.  Plot  of  12-Month  Moving  Average  of  F20430 
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Figure  A. 38.  Plot  of  12-Month  Moving  Average  of  F54130 
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Figure  A. 39.  Plot  of  12-Month  Moving  Average  of  TSK287 
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Figure  A.  40.  P]ot  of  1 2-MonVh  Moving  Avenge  of  F4  3!  3'i 
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Figure  A. 41.  Plot  of  12-Month  Moving  Average  of  F42732 


139 


12  MONTH  MOVING  AVERAGE  OF  PAYOFF 


F27131 

A=AVERAGE 

92.+ 


AAA 


AAAAA 


AAA 


90  ♦  + 


88.+ 


86.+ 


AA 


AA 


AA 


AA 


AAA 


AA 


AA 


AAA 


84.+ 


:  A 

:  a 

:  a 

82.+  A 

:  a 
:aa 


80.  + 

+ - + - + - + - + - + 

DJFMAM JJASOND JFMAM J JASOND JFMAM JJASOND JFMAM JJASONDJFMAMJ JASONDJ 
1974  1975  1976  1977  1978 


Figure  A.  42.  Plot  of  1 2-Month  Moving  Average  of  F27131 
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Figure  A. 43.  Plot  of  12-Month  Moving  Average  of  F42333 
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Figure  A. 44.  Plot  of  12-Month  Moving  Average  of  F23132 
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Figure  A. 45.  Plot  of  12-Month  Moving  Average  of  M23132 
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Figure  A. 46.  Spectrum  of  Detrended  Data  for  F30430 
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Figure  A.A7.  Spectrum  of  Detrended  Data  for  FA3130 
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Figure  A. 49.  Spectrum  of  Detrended  Data  for  F42333 
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Figure  A.  50.  Spectrum  of  Detrended  Data  for  F20'i30 
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CORRELATION  MATRIX 


Skill 

Level 

1 

2 

3 

4 

5 

1 

F30230  <  T ) 

E80F 

1.0000 

2 

F30331 ( T ) 

E80F 

0.9751 

1 .0000 

3 

F30333 ( T ) 

E80F 

0.9804 

0.9955 

1.0000 

4 

F30430 ( T ) 

E80F 

0.9875 

0.9917 

0.9945 

1.0000 

5 

F6723KT) 

A80F 

0.1403 

0.0065 

0.0399 

0.0750 

1.0000 

6 

F67232  <  T ) 

A80F 

0.1237 

-.0222 

0.0087 

0.0504 

0.9375 

7 

F20230 ( T ) 

G80F 

0.0865 

-.0518 

-.0308 

0.0174 

0.6022 

8 

F20530<  T ) 

G80F 

0.0707 

-.0675 

-.0490 

0.0006 

0.6105 

9 

F20830  <  T ) 

G80F 

0.0950 

-.0372 

-.0269 

0.0255 

0.4835 

10 

F25130 ( T ) 

G80F 

0.0915 

-.0495 

-.0279 

0.0204 

0.6089 

11 

F 46330<  T ) 

E70F 

0.4001 

0.3420 

0.3404 

0.3619 

0.1988 

12 

F46230  <  T ) 

E60F 

0.0737 

-.0060 

0.0094 

0.0314 

0.3481 

13 

F20430  <  T ) 

G60F 

0.0275 

-.1302 

-.0988 

-.0521 

0.6590 

14 

F54130 ( T ) 

E50F 

-.0033 

-.1036 

-.0804 

-.0570 

0.5002 

15 

F54230 ( T ) 

E50F 

0.0065 

-.1064 

-.0797 

-.0532 

0.5420 

16 

F54231 <T) 

E50F 

0.0158 

-.0962 

-.0661 

-.0428 

0.5700 

17 

F54232 ( T ) 

E50F 

0.0402 

-.0721 

-.0461 

-.0199 

0.5205 

18 

F54530 ( T ) 

E50F 

0.0043 

-.1031 

-.0761 

-.0546 

0.4946 

19 

TSK29S ( T) 

E50F 

-.0154 

-.1219 

-.0948 

-.0716 

0.5296 

20 

F43130<  T ) 

M50F 

0.1429 

0.0761 

0.0926 

0.1066 

0.1785 

21 

F42732<  T ) 

G50F 

0.0550 

-.0856 

-.0566 

-.0192 

0.6211 

22 

TSK287  <  T ) 

A50F 

0.0871 

-.0432 

-.0130 

0.0169 

0.5555 

23 

F23132  <  T ) 

G40F 

0.0580 

-.0890 

-.0555 

-.0176 

0.6380 

24 

F2713KT) 

A40F 

0.0542 

-.0794 

-.0481 

-.0177 

0.5903 

25 

F42333I T ) 

MOF 

0.2274 

0.2945 

0.2895 

0.2596 

-.2617 

26 

M30230  <  T ) 

E80M 

0.0391 

-.1002 

-.0785 

-.0361 

0.4051 

27 

M3033KT) 

E80M 

0.0229 

-.1043 

-.0843 

-.0458 

0.3615 

28 

M30333 ( T ) 

E80M 

0.0302 

-.1035 

-.0830 

-.0403 

0.3888 

29 

M30430  <  T ) 

E80M 

0.0399 

-.1016 

-.0803 

-.0329 

0.4108 

30 

M6723KT) 

A80M 

0.0037 

0.0253 

0.0135 

0.0072 

-.0984 

31 

M67232 ( T ) 

A80M 

0.0024 

0.0074 

-.0014 

-.0015 

-.0511 

32 

M20230  <  T ) 

G80M 

0.1100 

0.0285 

0.0335 

0.0554 

0.3656 

33 

M20530 ( T ) 

G80M 

0.1140 

0.0351 

0.0374 

0.0613 

0.3252 

34 

M20830 ( T ) 

G80M 

0.0196 

-.0416 

-.0571 

-.0247 

0.1011 

35 

M251 30 ( T ) 

G80M 

0.1267 

0.0441 

0.0503 

0.0710 

0.3693 

36 

M46330 ( T ) 

E70M 

-.0292 

-.1080 

-.0886 

-.0707 

0.2470 

37 

M46230  <  T ) 

E60M 

0  •  0558 

-.0462 

-.0266 

-.0019 

0.4316 

38 

M20430 ( T ) 

G60M 

0.0118 

-.1130 

-.0866 

-.0599 

0,4664 

39 

M54130I T ) 

E50M 

0.0523 

-.0576 

-.0336 

-.0060 

0.4598 

40 

M54230  <  T ) 

E50M 

0.0804 

-.0309 

-.0083 

0.0197 

0.4685 

41 

M54231 <  T ) 

E50M 

0.0775 

-.0354 

-.0108 

0.0161 

0.4738 

42 

M54232 ( T ) 

E50M 

0.0755 

-.0468 

-.0217 

0.0101 

0,5394 

43 

M54530CT) 

E50M 

0.0614 

-  .0632 

r-.0390 

-.0049 

0.5430 

44 

TSK296  <  T ) 

E50M 

0.0672 

-.0400 

-.0166 

0.0097 

0.4760 

45 

M431 30 ( T ) 

E50M 

0.0728 

-.0401 

-.0173 

0.0086 

0.4834 

46 

M42732 ( T ) 

G50M 

0.0118 

-.1130 

-.0866 

-.0599 

0.4664 

47 

TSK288  <  T ) 

A50M 

0.0779 

0.0101 

0.0265 

0.0335 

0.2877 

48 

M231 32 ( T ) 

G40M 

0.0113 

-.1224 

-.0938 

-.0606 

0.5059 

49 

M27131 (T) 

A40M 

0.0634 

-.0006 

0.0184 

0.0219 

0.2795 

50 

1442333  ( T ) 

M40M 

0.0907 

-.0087 

0.0124 

0.0331 

0.4442 

Table  1:  Correlation  Matrix  of  Raw  Payoff  Data 
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6 


7 


8 


9 


10 


6 

F67232<T> 

1.0000 

7 

F20230  <  T ) 

0.6383 

1.0000 

8 

F20530 ( T ) 

0.6457 

0.9940 

1 .0000 

9 

F20330  <  T ) 

0.5747 

0.7850 

0.7874 

1 . 0000 

10 

F25130 ( T ) 

0.6515 

0.9958 

0.9932 

0.7903 

1.0000 

11 

F46330 ( T ) 

0.1831 

0.2602 

0.2646 

0.2784 

0.2555 

12 

F46230 ( T ) 

0.3692 

0.4653 

0.4535 

0.3356 

0.4642 

13 

F20430 ( T ) 

0.6969 

0.7769 

0.7740 

0.6247 

0.7765 

14 

F54130 ( T ) 

0.5022 

0.5522 

0.5325 

0.3659 

0.5421 

15 

F54230 ( T ) 

0.5452 

0.5940 

0.5780 

0.4192 

0,5855 

16 

F54231 ( Y ) 

0.5494 

0.5898 

0.5787 

0.3847 

0.5875 

17 

F54232 ( T ) 

0.5209 

0.6070 

0.5893 

0.4069 

0.5988 

18 

F54530  <  T ) 

0.4862 

0.5734 

0.5514 

0.3670 

0.5621 

19 

TSK295  <  T ) 

0.5229 

0.5943 

0.5771 

0.3973 

0.5841 

20 

F431 30  <  T ) 

0.2224 

0.3196 

0.3001 

0.2572 

0.3342 

21 

F  42732 ( T ) 

0.6344 

0.7222 

0.7134 

0.5357 

0.7185 

nn 

A- 

TSK287 ( T ) 

0.5769 

0.6806 

0.6668 

0.4331 

0.6779 

23 

F23132  <  T ) 

0.6595 

0.7419 

0.7324 

0.5607 

0.7399 

24 

F27131 (T) 

0.6046 

0.6728 

0.6631 

0.4339 

0,6702 

25 

F42333 ( T ) 

-.2787 

-.1299 

-.1746 

-.1637 

-.1383 

26 

M30230 ( T ) 

0.4570 

0.6746 

0.6558 

0.5503 

0.6751 

27 

M3033KT) 

0.3950 

0.6579 

0.6452 

0,5424 

0.6552 

28 

M30333 ( T ) 

0.4321 

0.6917 

0.6773 

0.5595 

0.6892 

29 

M30430 ( T ) 

0.4543 

0.6936 

0.6809 

0.5722 

0.6931 

30 

M67231 ( T ) 

-.0308 

0.1696 

0.1564 

-.0010 

0.1643 

31 

M67232  <  T ) 

0.0288 

0.2614 

0.2486 

0.0931 

0.2542 

32 

M20230  <  T ) 

0.3740 

0.6089 

0 . 5902 

0.3723 

0.6053 

33 

M20530 ( T ) 

0.3458 

0.6057 

0.5385 

0,3990 

0.6021 

34 

M20830  <  T ) 

0.2142 

0.2534 

0.2572 

0.6265 

0.2644 

35 

M251 30  <  T ) 

0.3738 

0.6146 

0.5953 

0.37^7 

0.6105 

36 

M46330 ( T  ) 

0.2526 

0.3430 

0.3251 

0.2502 

0.3408 

37 

M46230 ( T  > 

0.4343 

0.5347 

0.5181 

0.3627 

0.5343 

38 

M20430 ( T ) 

0.4714 

0.53  99 

0.5237 

0 . 34 6 6 

0,54  28 

39 

M54 1 30  <  T ) 

0.4623 

0.5811 

0.5660 

0.36  4  2 

0 , 5785 

40 

M54230  <  T ) 

0.4746 

0.6006 

0.5847 

0.3730 

0.5996 

41 

M54231 (T) 

0.4820 

0,5974 

0,5798 

0.3671 

0.5964 

42 

M54232 ( T  > 

0.5518 

0.6629 

0.6497 

0.4504 

0.6608 

43 

M54530 ( T ) 

0.5470 

0.6450 

0.6313 

0.4380 

0,6420 

44 

TSK296 ( T ) 

0.4802 

0.5960 

0.5794 

0.3747 

0.5934 

45 

M  4  3 1 3  0  (  T  ) 

0.4812 

0.5627 

0.5468 

0.3661 

0.5605 

46 

M42732 ( T ) 

0.4714 

0.5399 

0.5237 

0.3466 

0.5423 

47 

TSK288 ( T ) 

0.2726 

0.4251 

0.3981 

0. 1593 

0. 41.89 

48 

M23132<  T ) 

0.5205 

0.5964 

0.5838 

0.4167 

0.5972 

49 

M  2  7 1 3 1 (T) 

0.2634 

0.3987 

0.3714 

0.  1454 

0,3962 

50 

M42333  <  T ) 

0.4332 

0.5444 

0.5254 

0.3443 

0.5411 

Table  1  (continued) 
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11 


12 


13 


15 


14 


11 

F46330( T ) 

1.0000 

12 

F46230  <  T ) 

0.5954 

1.0000 

13 

F20430 ( T ) 

0.4199 

0.7410 

1.0000 

14 

F54 1 30 ( T ) 

0.3903 

0.8107 

0.8540 

1.0000 

15 

F54230 ( T ) 

0.3848 

0.8267 

0.8963 

0.9782 

1.0000 

16 

F5423KT) 

0.3588 

0.7868 

0.8759 

0.9399 

0.9572 

17 

F54232 ( T  > 

0.3968 

0.8125 

0,8893 

0.9690 

0.9909 

18 

F54530 ( T ) 

0.3730 

0.8207 

0,3677 

0.9725 

0.9879 

19 

TRK?95<T> 

0 . 3  A 1  4 

0.8282 

0,8850 

0,9730 

0.9930 

20 

F431 30 ( T ) 

0.1816 

0.5055 

0.5109 

0.5775 

0.6197 

21 

F42732  <  T ) 

0.3871 

0.7404 

0,9596 

0,3955 

0.9352 

m 

TSK287  <  T ) 

0.3547 

0.7166 

0.9073 

0,8604 

0,9007 

23 

F23132<T) 

0.3488 

0.7163 

0.9596 

0.8784 

0.9240 

24 

F271 31 ( T ) 

0.3383 

0.7107 

0.9185 

0.8499 

0.8987 

25 

F42333 ( T ) 

0.1775 

0.3342 

0.0130 

0.2925 

0.2863 

26 

M30230 ( T ) 

0.3189 

0.6033 

0.7822 

0.6915 

0.7257 

27 

M30331 <  T ) 

0.3070 

0.5724 

0.7499 

0.6503 

0.6963 

28 

M30333  <  T ) 

0.3156 

0.5597 

0.7654 

0.6483 

0.6913 

29 

M30430 ( T ) 

0.3047 

0.5459 

0.7746 

0.6394 

0.6825 

30 

M67231 <  T  > 

-.0651 

-.0828 

-.0623 

-.0618 

-.0510 

31 

M67232  <  T ) 

-.0917 

-.0974 

0.0044 

-.0294 

-.0202 

32 

M20230 ( T ) 

0.3139 

0.4967 

0.6482 

0.6474 

0.6843 

33 

M20530 ( T ) 

0.3253 

0.4925 

0,6251 

0.6076 

0.6474 

34 

M20830 ( T ) 

0.2000 

0,0204 

0.1104 

- .0410 

-.0228 

35 

M251 30  <  T ) 

0.3299 

0.5222 

0.6570 

0.6677 

0.7016 

36 

M46330  <  T ) 

0.2517 

0.5934 

0.6525 

0.7107 

0.7454 

37 

M46230  •,  T ) 

0.3900 

0.7230 

0.8214 

0.8550 

0.3347 

38 

M20430 ( T ) 

0.3553 

0.7376 

0.8513 

0.8727 

0.9007 

39 

M541 30  <  T ) 

0.3643 

0.6973 

0,0440 

0.8609 

0.8914 

40 

M54230 ( I ) 

0.3684 

0.6945 

0.8407 

0.8481 

0,3323 

41 

M54231 ( I > 

0.3643 

0.6876 

0.8437 

0.8466 

0.8313 

42 

M54232  <  T ) 

0.3787 

0.6880 

0.8793 

0.8493 

0.8340 

43 

M54530  < i ) 

0.3957 

0.706C 

0.3362 

0.8612 

0.3944 

44 

TSK296  <  T ) 

0.3491 

0 .  *847 

0.8415 

0.8484 

0,8825 

45 

M  4  3 1 3  0  (  T  ) 

0.4071 

0.7353 

0.8442 

0.8720 

0.8975 

46 

M42732  <  T ) 

0.3553 

0. 7376 

0,3513 

0.8727 

0.9007 

47 

TSK288  <  T ) 

0.2941 

0.66 76 

0.6743 

0.8105 

0.8305 

48 

M23 1 32 ( T ) 

0.3632 

0.7442 

0.8955 

0.8743 

0.9073 

49 

M27131 (T) 

0.2697 

0.67*0 

0.6735 

0.8208 

0.8394 

50 

M42333 ( 7 ) 

0.3990 

0 . 7089 

0 . 7963 

0.8443 

0,8752 

15? 
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16 


17 


18 


19 


20 


16 

F54231 (T) 

1,0000 

17 

F54232  <  T ) 

0.9510 

1.0000 

18 

F54530  <  T ) 

0.9542 

0.9851 

1 .0000 

19 

TSK295 ( T ) 

0.9581 

0.9839 

0.9903 

1.0000 

20 

F43 1 30 ( T ) 

0.6399 

0.6365 

0.6453 

0.6094 

1 .0000 

21 

F42732 ( T ) 

0.9014 

0.9417 

0.9179 

0.9267 

0.5571 

22 

T SK287 ( T  ) 

0.8841 

0.9233 

0.8939 

0.8884 

0.6461 

23 

F231 32 ( T ) 

0.9030 

0.9302 

0.9035 

0.9164 

0.5780 

24 

F27131 <  T ) 

0.8845 

0.9130 

0.8890 

0.8866 

0.6321 

25 

F42333 ( T ) 

0,2488 

0.3115 

0.3324 

0.3009 

0.5027 

26 

M30230  <  T ) 

0.6880 

0.7270 

0.7100 

0.7020 

0.5741 

27 

M30331 (T) 

0.6551 

0.7053 

0.6832 

0.6756 

0.5851 

28 

M30333  <  T ) 

0.6472 

0.6981 

0.6771 

0.6670 

0.5598 

29 

M30430 ( T ) 

0.6506 

0.6901 

0.6648 

0.6558 

0.5750 

30 

M67231 <T) 

-.0740 

-.0453 

-.0436 

-.0304 

-  .  1232 

31 

M67232 ( T ) 

-.0406 

-.0145 

-.0209 

-.0043 

-.1002 

32 

M20230 ( T ) 

0,6604 

0.7232 

0.6926 

0.6636 

0.6293 

33 

M20530 ( T ) 

0.6084 

0.6824 

0.6500 

0.6243 

0 . 6083 

34 

M20830  < T  > 

-.0447 

-.0456 

-.0809 

-.0594 

0.1301 

35 

M251 30 ( T ) 

0.6710 

0.7393 

0.70S7 

0.6803 

0.6011 

36 

M46  330  <  T ) 

0.7161 

0.7496 

0. 7571 

0.7355 

0.6271 

37 

M46230 ( T ) 

0.8478 

0.8976 

0.8934 

0.8771 

0.7009 

38 

M20430(T> 

0.8843 

0.9142 

0.9005 

0.8859 

0 . 6941 

39 

M  5  4  1 3  0  <  T  ) 

0.8599 

0.9139 

0.8935 

0.8765 

0.6958 

40 

M5  42 30  < T  ) 

0.8532 

0.9066 

0.8845 

0.8689 

0.7036 

41 

M54231  <  T ) 

0.8525 

0.9059 

0.8825 

0.8653 

0.6978 

42 

M54232 ( T ) 

0.8518 

0.9055 

0.8789 

0.868  7 

0.6853 

43 

M  5  4  5  3  0  <  T ) 

0.8652 

0.9138 

0 . 8902 

0.3777 

0.66S1 

44 

TSK296 ( T> 

0.8513 

0.9051 

0 . 8849 

0 . 87 01 

0  •  6898 

45 

M  4  3 1 3  0  <  T  ) 

0.8675 

0.9181 

0  '004 

0.S837 

0.6892 

46 

M427  32  <  T ) 

0.8843 

0.91  42 

0 . 9005 

0 . 8859 

0.6941 

47 

TSK208 <  T  > 

0.8035 

0.9612 

0 . 8540 

0 , 8253 

0. 6968 

48 

M231 32<T ) 

0.8876 

0.9199 

0.8989 

0.8911 

0.6755 

49 

M27131 (T) 

0,8172 

0.8668 

0.8622 

0.8368 

0 . 7092 

50 

M42333 <  T ) 

0.8391 

0.9007 

0.8812 

0.8610 

0 . 7000 

Table  1  (continued) 
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21 

oo 

23 

24 

25 

21 

F42732 ( T ) 

1.0000 

O'? 

T  SK2S7 ( T ) 

0.9437 

1.0000 

23 

F231 32( T  ) 

0.9823 

0.9551 

1.0000 

24 

F27131 ( D 

0.9463 

0.9893 

0.9620 

1 . 0000 

25 

F42333 ( T  ) 

0.1625 

0.2450 

0.1304 

0 . 1947 

1 .0000 

26 

M30230 ( T ) 

0.77SS 

0.8013 

0.7927 

0.8000 

0. 1400 

27 

M30331 <T) 

0.7488 

0.7794 

0.7665 

0.7846 

0. 1467 

28 

M30333 ( T ) 

0.7615 

0.7802 

0.7712 

0.7871 

0. 1129 

29 

M30430 ( T ) 

0.7608 

0.7880 

0.7812 

0 . 7945 

0.0'.  20 

30 

M67231 (T> 

-.0465 

-.0116 

-.0393 

- .0649 

0.0625 

31 

M67232 ( T ) 

0.0036 

0.0328 

0.0174 

- .0176 

- .0225 

32 

M20230 ( T > 

0.7219 

0. 7923 

0.7121 

0.7629 

0.3673 

33 

M20530 ( T  ) 

0.6872 

0.7509 

0.6768 

0.7274 

0.3539 

34 

M20330  <  T ) 

0.0366 

-.0405 

0.0493 

-  .0430 

-.0935 

35 

M25 1 30  <  T ) 

0.7397 

0.7959 

0.7256 

0. 7645 

0 . 3829 

36 

M46330 ( T ) 

0.7550 

0.7626 

0.7412 

0.7726 

0.4510 

37 

M46230  <  T ) 

0.8909 

0.9221 

0.8819 

0.9176 

0.39  16 

38 

M20430 ( T ) 

0.8929 

0.9461 

0.0907 

0.9306 

0.3150 

39 

M54 1 30(1 ) 

0.9020 

0.9588 

0.9032 

0.9501 

0.3351 

40 

M  5  4  2  3  0  (  T) 

0.9022 

0.9607 

0.9029 

0 . 9504 

0.3475 

41 

M54231  <  T ) 

0.9035 

0.9655 

0.9067 

0  •  9  5' 6  4 

0.3263 

42 

M54232 ( T ) 

0.9207 

0.9665 

0 . 9239 

0.9608 

0 . 2  >'7  5 

43 

M54530  <  T ) 

0.9232 

0.9641 

0.9221 

0 . 95 9 G 

0 . 2  6  0  1 

44 

TSK296  <  T ) 

0.8992 

0.9577 

0 . 9007 

0 . 9479 

0 . 3394 

45 

M431 30 ( T ) 

0.8991 

0.9517 

0.9010 

0.9455 

0.3457 

46 

H  4  2 7  3 2  (  !' ) 

0.8929 

0.9461 

0 . 8  9  B  7 

0.9386 

.'.31  50 

47 

TSK288 ( 7 ) 

0.7937 

0.8769 

0 . 7789 

0 , 74  Ov 

•  .  1 

48 

M23 1 32  <  T ) 

0.9195 

0.9579 

0.9771 

0 . 9  5  6>  4 

0 . 7494 

49 

M27131 (T> 

0.7846 

0.8737 

0.7/66 

0 . 8 4 60 

0, 5581 

50 

M42333 ( T ) 

0.8750 

0 . 9334 

0.8716 

0.9231 

0 . 4740 

26 


27 


28 


29 


30 


26  M30230 ( T ) 

27  rt30331(T) 

28  M30333  <  T ) 

29  M30430 (  T ) 

30  M6723KT) 

31  (167232  (  i  » 

32  M20230  <  T ) 

33  M205  30 ( T ) 

34  M20S30 ( T ) 

35  M251 30 ( T ) 

36  M 4 6 3 3 0 (  1 ) 

37  M46230 ( T ) 

38  M20430<T> 

39  M54 1 30 ( T) 

40  M54230 ( T ) 

41  M5423 l ( T ) 

42  h 5 4 2 3 2  < T ) 

43  M54530'  r  > 

44  T5K  2^6  •'  T  > 

45  M43130< r ) 

46  M  4  2  7 3 2  f T ) 
4  7  T5K2S8(D 

48  rt23l32(.  T ) 

49  M2 71 3.1  (  7  ) 

50  M42333 <  T  ) 


31 

M67232 ( T ) 

32 

M20230 ( T i 

33 

M20330C  T> 

34 

(120830  (  T } 

35 

M251  '?<.»<  T ) 

36 

M 46 336 

><  f ) 

37 

M 46 2 30 

;  (  r  5 

38 

M 20 4 30 

-  ( r  .< 

39 

M54170 

<  r ) 

40 

M54230 

(  T  ) 

41 

h'jApj  i 

(  r  i 

4  2 

ms 4 2 

<  I  i 

43 

MS  45  211 

\  i  > 

44 

T5K  :•  96 

< r  > 

45 

M  4  5 1  .50 

:  T  > 

46 

M42 77; 

•  r  > 

47 

T5t  OP.', 

<  T  > 

48 

M2 3  1  3  2 

<  r ) 

4  9 

M  2  7131 

( r  > 

50 

M  4  2  7  3  3  (  T  > 

1 .0000 

0.9698 

1 .0000 

0.9751 

0.9808 

0.9738 

0.9804 

0.0243 

-.0175 

0.1090 

0.0706 

0.7663 

0.7685 

0.7680 

0.7692 

0.2709 

0.2506 

0.7659 

0.7596 

0.7374 

0.7476 

0. 7898 

0.7716 

0.7916 

0.7626 

0.7909 

0.7848 

0.8023 

0.7916 

0.8027 

0 . 7941 

0.8192 

0.8079 

0.8176 

0.8046 

0.7830 

0.7767 

0.7726 

0.7619 

0.7916 

0.7626 

0.6885 

0.6685 

0.8019 

0.7759 

0.6689 

0  •  6510 

0.7776 

0.7723 

31 

32 

1.0000 

0.3333 

1 .0000 

0.3602 

0.9839 

0.1106 

0. 1679 

0.3454 

0 . ?9 1 R 

-.0978 

0 . 6670 

-.0327 

0.7787 

-.0426 

0.7480 

-.0041 

0.8005 

0.0293 

0. 8201 

0 . 0294 

0.8216 

0.0225 

0.8076 

-.0138 

0.7974 

0.0339 

0.8163 

-.0470 

0.7822 

-.0426 

0.7400 

0.0562 

0.7071 

-.0678 

0.7166 

0.0275 

0.7639 

-.0314 

0.0178 

1 . 0000 

0.9878 

1 .0000 

0.0197 

-.0038 

0. 1096 

0.0861 

0.7775 

0.7610 

0.7814 

0,7592 

0.2651 

0.2807 

0.7694 

0.7518 

0.7223 

0.7218 

0. 7628 

0,760? 

0.7501 

0.7648 

0.7780 

0,7829 

0. 7887 

0.7925 

0.7922 

0.7962 

0.8111 

0.8157 

0.8056 

0.8126 

0.7728 

0.7744 

0.7568 

0.7609 

0.7501 

0,7643 

0.6537 

0.6460 

0.7690 

0.7839 

0.6268 

0*6196 

0.7625 

0.7615 

33 

34 

1 .0000 

0.2335 

1.0000 

0.9827 

0.164? 

0 . 6344 

0 . 0060 

0. 74  7*1 

-.0336 

0 . 708V 

- .0382 

0. 7624 

- .0722 

0 . 7844 

-.0576 

0. 7348 

-.0606 

0.7755 

-.0114 

0,7643 

-.0173 

0.7829 

-.0646 

0.7461 

-.0577 

0,7037 

- ,  0382 

0.7416 

-.  1875 

0,6329 

-.0238 

0.7178 

-.2052 

0.7854 

-.0354 

Table  1  (continued) 


1.0000 

0.9762 

0.2954 

0.3205 

0.0399 

0.3115 

-.1018 

-.0494 

-.0639 

-.0321 

0.0002 

-.0008 

-.0191 

-.0517 

0.0078 

-.0631 

-.0639 

0.0684 

-.1049 

0.0383 

-.0432 


35 


1 .0000 
0.6811 
0 . 7886 
0.7564 
0.8052 
0.8252 
0.8261 
0.8121 
0.8015 
0.8221 
0 . 7683 
0  *  756*) 
0.8007 
0.7239 
0.7766 
0.8265 


153 


36 


37 


38 


3? 


40 


36 

M  4  6  3  3  0  (  T  ) 

1.0000 

37 

M46230 ( T ) 

0.8762 

38 

M20430 ( T ) 

0.8326 

39 

M54 1 30 ( T ) 

0.8346 

40 

H54230 ( T ) 

0.8281 

41 

M54231 <T) 

0.8341 

42 

H54232 ( T ) 

0.7945 

43 

M54530 ( T ) 

0.8031 

44 

TSK296  <  T  ) 

0.8279 

45 

M43130(T> 

0.8236 

46 

M42732 ( T ) 

0.8326 

47 

TSK288 ( T ) 

0.8237 

48 

M231 32 ( T  > 

0.8014 

49 

M27131  (T) 

0.813S 

50 

M42333  <  T ) 

0.8328 

41 

41 

M54231 (T) 

1.0000 

42 

M  5  4  2  3  2  (  T  ) 

0.9881 

43 

M54530 ( T  ) 

0.9863 

44 

TSK296 ( T ) 

0.9933 

45 

M431 30 ( T ) 

0.9846 

46 

M  4  2  7  3  2  <  T  ) 

0.9680 

47 

T  SK288 ( T ) 

0.9288 

48 

M231 32<  T  > 

0.9647 

49 

M27131 <  T ) 

0 . 9235 

50 

M42333 ( T ) 

0.9772 

46 

46 

M42732 ( T ) 

1 .0000 

47 

TSK283 ( T ) 

0.9171 

48 

M231 32 ( T ) 

0.9856 

49 

h  2  7 1 3 1  <  T  ) 

0,9220 

50 

M  4  2  3  3  3  (  T  ) 

0.9572 

1.0000 

0.9597 

0.9773 

1.0000 

0.9725 

1 .0000 

0.9765 

0.9674 

0.9956 

0.9723 

0,9680 

0.9946 

0.9647 

0.9543 

0.9878 

0.9659 

0.9638 

0.9865 

0,9761 

0.9626 

0.9948 

0.9751 

0.9761 

0.9898 

0,9597 

1.0000 

0 . Q725 

0.9261 

0.9171 

0.9318 

0.9500 

0.9S56 

0.9709 

0.9262 

0.9220 

0.9293 

0.9751 

0.9572 

0.9819 

42 

43 

44 

1 .0000 
0.9940 

1.0000 

0.9885 

0.9842 

1.0000 

0.9799 

0.9828 

0 . 9864 

0,9543 

0.9638 

0.9626 

0.8913 

0.808  7 

0 . 9297 

0,9659 

0.9738 

0.9584 

0.8832 

0.8817 

0.9275 

0.96S5 

0.9664 

0 . 9  7  9  9 

47 

48 

49 

1 ,0000 

0.8792 

1 ,0000 

0.9910 

0.8815 

1 .0000 

0,9470 

0.9433 

0.9427 

1  '>f. 


1.0000 
0.9962 
0.9900 
0.9864 
0,?<?46 
0 . 9861 
0.9674 
0.9336 
0 . 9643 
0.9277 
0.9790 


45 


1 .0000 
0.9751 
0.9249 
0.9717 
0 . 9235 
0.9853 


50 


1 .0000 


Table  1  (concluded) 


CORRELATION  MATRIX 


1 

9 

3 

4 

cr 

O 

1 

F30230 ( T ) 

1.0000 

n 

F3033.1  ( T ) 

0.9900 

1 .0000 

3 

F30333 ( T  > 

0.9917 

0.9956 

1 . 0000 

4 

F30430 ( T  ) 

0.9911 

0.9952 

0.9957 

1 . 0000 

5 

F67231 ( T ) 

0.3563 

0.3085 

0.3314 

0.3244 

1 .0000 

6 

F67232 ( T ) 

0.3604 

0.3072 

0.3316 

0 . 3266 

0.9292 

7 

F20230  <  T ) 

0.0699 

0.0623 

0.0670 

0.0600 

0. 1409 

9 

F20530  <  T ) 

0.0390 

0.0357 

0.0355 

0.0287 

0 . 1107 

? 

F20830 ( T ) 

0.1933 

0.1753 

0.1892 

0. 1865 

0. 1708 

10 

F25130 ( T ) 

0.1048 

0.0920 

0.0993 

0.0898 

0.1726 

11 

F46330 ( T ) 

0,4283 

0.4486 

0.4344 

0 .4340 

0.0054 

12 

F46230 ( T ) 

0.3114 

0.3571 

0.3398 

0.3410 

-. 1993 

13 

F20430 ( T ) 

0.1694 

0.1573 

0. 1660 

0. 1772 

0.2927 

14 

F54 1 30 ( T ) 

0.1592 

0.1809 

0.1725 

0.1817 

0 . 1030 

15 

F54230 ( T ) 

0.1734 

0.1799 

0. 1793 

0.1919 

0.2129 

16 

F5423KT) 

0. 1866 

0.1901 

0.1985 

0. 1988 

0.3553 

17 

F  5  4  2  3  2  (  T  > 

0.1742 

0 .1845 

0.1789 

0 . 1940 

0.0814 

18 

F54530 ( T ) 

0.0818 

0.0792 

0.0300 

0.0891 

0. 1445 

19 

TSK295  <  T ) 

0.0746 

0 • 0866 

0.0876 

0 . 0928 

0 . 1895 

20 

F43 1 30 ( T ) 

0. 1608 

0. 1576 

0.1660 

0.1649 

- .0122 

21 

F42732IT) 

0. 1250 

0.1200 

0.1251 

0. 1308 

0.1941 

22 

T8K287 ( T ) 

0.2108 

0.2181 

0.2239 

0.2197 

0 . 14  77 

23 

F23 1 32 ( T ) 

0.0954 

0.0840 

0.0985 

0. 1030 

0.3751 

24 

F27131 <T) 

0.0524 

0.0606 

0.0630 

0.C522 

0.3007 

25 

F  4  2  3  3  3  <!  T  ) 

0.2901 

0.3306 

0.3329 

0.3251 

- . 1494 

26 

M30230 ( T ) 

-.0100 

- .0473 

-.0394 

-.0339 

- . 0332 

27 

M30331 (!) 

-.0756 

- . 0985 

- .0956 

-.0902 

-.1319 

20 

M  3  0  3  3  3  <  T  ) 

-.0923 

-. 1205 

- . 1 150 

~. 1085 

1564 

29 

M30430  <  T ) 

-.0554 

-  .0920 

- .0880 

- . 0738 

-.1153 

30 

M67231 (T) 

-.0730 

-  .0893 

- .0898 

-  .  0881 

0.0344 

31 

MA723? ( T ) 

-.0495 

-.0594 

- . 0601 

-  .  ( '  6  0  4 

-.0036 

32 

M  2  0  2  3  0  <  T  ) 

-.1066 

-.1053 

- . i 289 

-.1721 

('•  ,  0*35 

33 

M 20 5 30 ( T  > 

-. 1284 

-  ,  1  163 

- . 1 460 

- . 1323 

-  «•;,  c 

34 

M20030 ( T ; 

-.0364 

- . 0442 

...  t 

.  04  34 

■'  .  1  r30 

35 

M25 130(1) 

-.0456 

-.0477 

-.0719 

-.0*41 

0 . 075 i 

36 

M  4  6  3  3  0  (  D 

-. 1292 

-.1351 

- . 1307 

-  .  1095 

-  .0*19 

37 

M46230 ( T ) 

-.0440 

-.0270 

- . 0444 

-  .  0296 

- .04 7 8 

38 

M2 04 30 ( T  ) 

- .0509 

-  .  1079 

- . 1086 

.  0351 

0 . 1V  '<  " 

39 

M 5  4 1 3  0  < T) 

-.0901 

-.0797 

-  .  09  l  . 

-  ,  o5o5 

.  •  O  ■ 

40 

M54230  <  T ) 

0 . 0467 

0.0569 

0 . 0388 

0 . 0*49 

-  .17  "6 

41 

M54231 < T ) 

0.0429 

0 . 05 1 9 

0.0376 

0.0621 

-  .  0  4  3  2 

42 

MS 4 232 ( T  ) 

0.0080 

0.0164 

0 . 0089 

0 .0218 

.  07  74 

43 

MS  4530 (  D 

0.0416 

0 . 03 78 

0 . 0  2  2  P 

0 . 0355 

0 . 0  4  6  ' 

44 

TSK296  <  T ) 

- .0335 

-.0221 

- . 0370 

-.0122 

-  .  0  39  3 

45 

M43130CT) 

0.0441 

0 . 0335 

0 .0182 

0.041  9 

O  .  '>473 

46 

M  4  2  7  3  2  <  T  ) 

-.0509 

-.1079 

- . 1086 

- . 0851 

<  .  1  "8  7 

47 

TSK288  <  T ) 

0.0789 

0.0619 

0.0422 

0.0511 

.  1  7*7 

40 

M23.1. 32<  I  > 

- .0134 

-.0315 

- .0376 

- .  007;'. 

.  !  •  "7 

49 

.'1271  :  on 

0  .  J  3.'  • : 

0.  1  L-45 

0.1 

o.l’ 

•  ,  1  ■: 

[  ,r, 

M4 "  ’  1  (  :  ) 

-  ,  o  2:  : 1 : 

,  >  )  ..  v  \ 

» 

Table  2:  Correlation  Matrix  for  Differenced  Data 


6 


7 


0 


9 


10 


6  rA7:>7._’<r>  i.oooo 


7 

8 

V 

F  202  'O'  r  ' 

P  205  3'*  (  T  > 

F  708  30 (  r  ) 

0.0907 

0.0532 

0. 152  7 

1 .0000 
0.9765 

0 .6794 

1 . 0000 
0.6502 

1 .0000 

1  0 

f  ",l  OI[) 

0.1315 

0.9761 

0  ;  °  7  2  Q 

0 . 6958 

1 . 0000 

1 1 

P  46  5  50 ( T  > 

- .0272 

-.0961 

-.0  799 

-.0678 

- . 1071 

12 

f  4  6730 ( T > 

-. 1963 

0. 1764 

0. 1846 

0 . 0967 

0.1473 

1  3 

F  20  4  30 (  1  ) 

0.2880 

0.3103 

0.3215 

0.3174 

0.2879 

1  4 

P  54 1 30 < r  > 

0. 1307 

0.2004 

0.76  15 

0 . 1900 

0.2294 

15 

r 54  230 < r  > 

0. 2040 

0.2282 

0.224  4 

0.2734 

0.1817 

16 

F  5  4231 ( 7  > 

0.2910 

0.2110 

0.2250 

0.1838 

0.2138 

17 

P  5  47  37  <  7  ) 

0.0764 

0 . 2  70S 

0.2566 

0.3031 

0 . 2269 

18 

F 54550 (  7  ) 

0 . 1028 

0.3262 

0 . 29  78 

0.2542 

0  •  2553 

19 

I  55  295 ( 7 ) 

0. 1620 

0.3130 

0.3063 

0.2318 

0 . 2588 

20 

F  4  7  1  70  (  7  ) 

-.0511 

-.0380 

-.03  2  0 

-.0745 

0.0314 

21 

F  4  7 7  37 <  1  ) 

0. 1803 

0.2426 

0 . 74  60 

0.2742 

0.2240 

"> 

7 SP> 2 8  7(  7  ) 

0.2547 

0.0447 

0.0362 

0.0122 

0.0246 

23 

F  2  3 1  32(  7  ) 

0 . 3850 

0.3103 

0 .3116 

0 . 2865 

0.3138 

24 

F  2 7131(7) 

0 . 3490 

-.0942 

-.0343 

-  .0288 

-.1199 

25 

F4 2 333(7) 

-.1653 

0.0817 

0.0217 

0. 1544 

0.0440 

26 

Pt'JO  530  (  7  ) 

-.0142 

0.0018 

-  .  0021 

- .0372 

0.0137 

27 

PI  3  0  331  (  7  ) 

-.1677 

-.0209 

-  .  0019 

- .0244 

-.0176 

28 

PI  3  0  3  33  (  7  ) 

-.1799 

- .0741 

- . 0699 

-.0447 

-.0691 

29 

PI 30  4 30  (  7  ) 

-.1431 

- .0872 

- .0350 

-.0961 

- .0782 

30 

PI  6  72  31(1) 

0.1375 

-.0791 

- . 0856 

-.2272 

-.0762 

31 

P1672  32  (  7  ) 

0.0917 

-.0851 

-.0891 

-.2178 

-.0794 

32 

M 70 750 ( T  ) 

0.0144 

- .1299 

- . 1256 

1201 

- . 1039 

33 

P12O530  (  7  ) 

-. 1064 

-  .  1528 

- . 1356 

-.0304 

-. 1421 

3  4 

M205  30(7  ) 

0. 1435 

-  .029  7 

-  .0238 

0. 1678 

0.0008 

35 

PI  7  5  1  30(7) 

0 . 0210 

- .0584 

- . 04 70 

-.0.346 

-  .  03*7  4 

36 

M  l/  <  '0  •:  7  > 

- .0750 

- . 1 393 

-.131  6 

- .0016 

- . 1526 

3  7 

H 46.7 JOt  i  ' 

- .0464 

■  . 1 853 

- . 1 302 

-.0  7(34 

-.1513 

38 

M  ■ . 1  1  4  i  0  (  T  ' 

0. 1475 

•  1255 

.  1001 

-.083/ 

—  >  OF! 03 

39 

M 5  1  1  30 (  I  ' 

- . 1565 

- . 7466 

-.1691 

- . 1449 

- . 2354 

40 

PI  5  4  7  30  (  7  ' 

-.1152 

- . 2647 

- .7176 

-. 1667 

-.2261 

41 

M  5  4  2  '1  <  r  ' 

-.0118 

'  4  1 

-.2441 

- .1772 

- . 2295 

42 

M  5  4  7  .3  7  •;  7  ) 

0.0077 

-  .  1  56? 

-.1231 

-.0722 

-  .  1/165 

43 

n'j  157.0  1  r  ) 

0 . 0  48  ’ 

.  7  1  10 

-  .19  17 

- . 1099 

- .2136 

4  4 

T  51, 7  V/:,  1  r  > 

-  .  9  1  6'. 

.  70  4  7 

-  .  1  6  v  3 

- .0720 

-  .  2013 

4  5 

M  4  (1  O.o  f  > 

0 .  "  37 

-  . 2 20 7 

-  .  7  3  20 

- .0716 

-.2233 

46 

PI  4  7  •’  3  7  <  1  ' 

0.14  '5 

.  1  705 

- . 1001 

-.0887 

-.0303 

47 

r '  p  r  ■ 

-.17 

,060'’ 

.  0176 

-  .0135 

-.0422 

4  8 

M  7  \  1  ‘ ’  !  1 

.  O  9  ■ : ; 

.  1  4'  0 

-.11  99 

0.0021 

-  .  1 ,349 

4  9 

Pi  7  7  1  '  l  '  r 

.  0  < 

0.1143 

0 . 1  3  7  3 

0. 1634 

0 . 1564 

50 

h  4  7  r  1 

0 . 0  3  4  5 

.1115 

-  .07 5 4 

0.0320 

-.1133 

r.iMi  O  *  'il  .1 ) 

1  r.H 


11 


12 


13 


15 


1 1 

F 46330 ( T  ) 

1.0000 

12 

F 46230 ( T ) 

0.6270 

13 

F 20430 < 1 ) 

0.1965 

14 

F54.130C  T  > 

0.1620 

15 

F 5 4 2  30  <  T  ) 

0.1412 

16 

F54231 (I) 

0.1272 

17 

F  5  4  2  3 2  (  I  ) 

0.1320 

18 

F 5 4530 ( T ) 

0.1271 

1? 

TSK295 ( D 

0.0S60 

20 

F43130( T) 

-.0041 

21 

F42732 ( T l 

0. 1076 

T  S  K  2  8  7  (  T  ) 

0.1398 

23 

F  2  3 1  3  2  (  T  l 

-.0612 

24 

F27131 <  T ) 

0.1191 

25 

F  42  333  <  T ) 

0 . 253  7 

26 

*30230  <  T ) 

0.1377 

n  -j 

M30331 ( T ) 

0.1310 

28 

M  3  0  3  3  3  <  T  ) 

0.0931 

29 

M  3  0  4  3  0  (  1  > 

0.0842 

30 

M67231 ( T ) 

- .1740 

31 

M67232 <  T ) 

-.2366 

32 

M20230  <  T ) 

0.0838 

33 

*20530  < 1 ) 

0.0831 

34 

M  2  0  8  3  0  (  T  1 

0.1472 

35 

*251  3  0  •;  T  ) 

0.0813 

36 

*46330  < T ) 

0.0355 

37 

M 462301 T ) 

0. 1857 

38 

*  2 0 4 3 0(1) 

-.0737 

39 

*54 1  30 c  1  ) 

0.0444 

40 

*5  4  730 '  r ) 

0.0964 

41 

M5423 t  < T ) 

0 . 0984 

42 

M  5  4  7  3  2  k  T  1 

0 .1212 

43 

*'.  i  45  30  (  r  '< 

0 .1055 

44 

rsi  •  ‘  t  > 

-.0556 

45 

M  4  (1  ’  0  1  T  ) 

0.1201 

4  6 

M4  ’  i  '■ 

-.0737 

4  7 

1:4,28:0  r 

0. 1736 

48 

M  2  3  1  >  2  t  I  > 

0.0743 

49 

*  2  >  1  3  l  <  n 

-.0285 

50 

*42  33  3  i  1  ) 

0,2279 

1  -1 


1 .0000 

0.2196 

1 . 0000 

0.3780 

0.5570 

1 . 0000 

0.3782 

0.6900 

0 . 8420 

1 . 0000 

0.3034 

0.4932 

0 . 61  4S 

0 . 7099 

0.3839 

0.6532 

0.8261 

0 . 9426 

0 . 4009 

0.6064 

0.0253 

0 . 9003 

0 . 3899 

0.664/ 

0.8345 

0 , 9504 

0.0640 

-.1946 

1003 

-  ,0314 

0.1091 

0.8638 

0.4725 

0 . 6179 

0 . 1 468 

0.4608 

0. 1853 

0.2385 

0.0564 

0 . 7602 

0 . 4842 

<)  ,  6  385 

0.0915 

0 . 4760 

0 . 1063 

0 , 2  S  4  4 

0.3050 

0. 12“'1 

0.2600 

0 . 2608 

0. 1014 

0. 1774 

0.0545 

0.0299 

0.1297 

0 . 1459 

-.0127 

0 . 0098 

0 . 0947 

0. 1440 

-.0036 

0.015-- 

0.05 "2 

0 . 1 390 

-.0276 

- .0391 

-  .  1003 

-.0210 

-.0215 

- .0173 

-  .  1500 

- . 0263 

0 . 0232 

0.0001 

■  .  1594 

0 . 1 529 

-.0285 

0.0228 

-  .0490 

0 . 1053 

-.0047 

0 . 0499 

- . 0249 

0.2035 

0.0759 

0 . 1050 

-  .  10  78 

0.2575 

0.0601 

0. 1160 

-.0569 

0.2167 

- . 1 156 

-.01 9 3 

-  .0776 

0 . 0821 

-.0832 

- .0971 

-.2101 

0.1164 

-  . 1523 

- . 1 320 

-  .  166  ’ 

0 . 0675 

- . 0886 

- . 1 052 

-.2303 

- . 0531 

-  .  2  3  2  4 

.  2 1 6  ■" 

-  .  190  7 

0 . 0270 

-.2094 

1  04  f  4 

♦  4.  C  7  t 

♦  1  /  '  c 

0.0947 

-  .0  320 

- . 0978 

-.11 78 

0.2111 

0.0430 

0 . 032 7 

-.2712 

0 .061 0 

- . 1716 

-  .  1  6  7  5 

-.1336 

0 .  oo9.; 

-  .  060  4 

- . 1 394 

- .  2  1  8  1 

0.11  6  •> 

-  .  152  3 

-  .  1  i  20 

0.054  5 

0 . 06  -0 

- . 0597 

-  .  0  5  3  <. 1 

-.0016 

0 . 1 537 

.  0  5  0  0 

0.013 2 

-  .  0060 

0 . 0  4  9  7 

—  f  0  o  6  £> 

-  .  Ois  1  3 

-.0486 

0 . 1104 

-  ♦  1  20*5 

-.11 5 7 

Table  2  (com  inuoil) 
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1 6 


17 


18 


19 


20 


16 

854231 (T) 

1.0000 

17 

F54232  <  T ) 

0.6540 

1.0000 

18 

F54530 ( T  > 

0.7306 

0,8829 

1 .0000 

19 

T  S  K  2  9  5  (  T  ) 

0.7373 

0.9150 

0.9317 

1 .0000 

20 

F  4  3 1 3  0  (  T  > 

0.2682 

-.0340 

0 . 1037 

0 . 0066 

1 . 0000 

21 

F  4  2  7  3  2  (  T  ) 

0.4135 

0 . 6444 

0 . 5005 

0.5931 

-  .  2669 

TSK287  <  T ) 

0.1827 

0.2491 

0. 1560 

0,2523 

-.1195 

23 

F23132 ( T ) 

0.5087 

0.6090 

0 . 4996 

0 . 6589 

- . 2443 

24 

F  2  7 1  3  1  <  T  > 

0.2311 

0.1613 

0.1513 

0 . 2656 

-  .  2226 

25 

F  4  2  3  3  3  (  T  ) 

0.1879 

0 . 2737 

0 . 2889 

0.2839 

0.3155 

26 

M30230CT) 

-.1260 

-.0249 

0.0273 

0.0059 

-.2617 

27 

M30331 (T) 

-.1561 

-  .  0240 

0.0169 

0 . 0095 

-  .  2333 

28 

M30333 ( T ) 

- .1883 

-.0460 

0.0142 

-.0097 

- . 2528 

29 

M30430 ( T  ) 

-.1714 

-.0376 

-.0196 

-  .0627 

- .2095 

30 

h  6)723 1  (T) 

-.0025 

-.0811 

- . 0758 

0.0552 

-  .  1  463 

31 

M67232 ( T ) 

0.0010 

-.0433 

-.0581 

o 

o 

N>i 

-.1419 

32 

M  2  0  2  3  0  (  T  ) 

-.0116 

0.0092 

0.0305 

0.0155 

0.095ft 

33 

M  2  0  5  3  0  <  T  > 

-.1116 

0 . 0039 

0.0  ICS 

0 . 0102 

0.0  4  58 

34 

(170830 ( T  ) 

0.0310 

0.0b  0  4' 

0 . 0085 

0.0159 

-  .  009  2 

35 

M2 5 130 < T ) 

0.0065 

0.1124 

0.0846 

0 . 0803 

-  .  0  4  5  0 

36 

M46330 ( T  > 

-.1343 

- .0732 

-.1104 

-  .  0  5  6  1 

-  .  2701 

37 

M  4  A  7  3  0  '  T  > 

-.  1864 

-  .  1867 

.  1  270 

-.11 20 

- . 00ft 8 

38 

M  2  0  4  3  0 ( T) 

-.11 64 

-  .  1  7  1  2 

- . 1533 

-  .  1654 

o .  o  o  r  9 

3  V 

(15  4130(1) 

-.2269 

-  .  1632 

- . 1 602 

-  .  1  5  7  7 

-  .  0  5  4  2 

40 

M54  2  30 ( T  > 

- .2566 

-  .  2700 

- .  2  0  4  ~ 

■  .  2700 

0 . 0651 

41 

M  7  !  •'  T  ) 

-  .  2  e>  8  9 

-.24  8 7 

-  .  3  1  4  o 

-  .  3  5  2 

-  . :  •  4  *  1 

4  2 

Mr. 4  ‘  2  i  ) 

- . 2373 

-  .  16  45 

- . 1478 

-  .  1  473 

-.14  j 

4  3 

fl  .45  (  r  ) 

- . 1203 

-  .  0  4  6  0 

-  .6.0  (> 

-  .0572 

- . 6 700 

4  4 

fsk  O'-’o  r  r  > 

- . 2922 

.  23  4  0 

>  :  q  ■> 

-.21 3 6 

-  .  C  >  i  9  3 

4  5 

M  4 3 1  7  0 <  !  ) 

- . 2579 

-  .  73  1  1 

-  .  1  AA\*> 

-  #  i  o  r  , 

~  ,  l  ’  “  A 

46 

M  1  5  7  2  <  r  > 

-.1164 

-  .  171  2 

-  . 1533 

-  ,  1654 

0 . 1 '  0  7 

4  7 

TSF 7 HO ( T  i 

-  ,  05'> 4 

••  •  0  4  4  3 

•  .  0  2  8  4 

-  .  0  "  1 6 

-  .  0  7  5  4 

4  8 

M2  5 1  i  > 

- . 0465 

-  *  <v<w 

•  ♦  v '  1'"  1  7 

•  .  0  451 

0  .  .'3  4  4 

4  9 

m  i  '  i  '  r ) 

0 , 0  i  0  7 

-  «  0  7  >  A 

•  V  1  K  >  O 

-■ .  0488 

1  5  7  ’ 

50 

(1 4  23.  3  2. '  I  1 

-  .  2  7  1  1 

7 1 75 

.  1  5  4  9 

- . 1 762 

-.31 9 8 

Table  ?.  (eon 1 1  niii'd ) 


21 

21 

F42732  <  T ) 

1.0000 

OO 

TSK287  <  T ) 

0.5145 

23 

F23132(T) 

0.8192 

24 

F27131 <T> 

0.4811 

25 

F42333  <  T  > 

0. 1277 

26 

M  3  0 2  3  0  <  T ) 

0.1050 

27 

M30331 (T) 

0.0548 

28 

M30333 ( T ) 

0.0823 

29 

M  3  0  4  3  0  (  T  ) 

0.0543 

30 

M6723KT) 

0.0232 

31 

H67232 ( T ) 

0.0439 

32 

M20230 ( T ) 

0.1814 

33 

M20530 ( T ) 

0.0929 

34 

M20830 ( T ) 

0.1928 

35 

M25130CT) 

0.3046 

36 

M46330  <  T ) 

0.3061 

37 

M  4  6  2  3  0  <  T  ) 

0.1011 

38 

M20430 ( T ) 

0.0530 

39 

M54 1 30 ( T ) 

0.0468 

40 

H54230CD 

0.0034 

41 

M5423KT) 

0.1080 

42 

M  5  4  2  3  2  <  T  ) 

0.0667 

43 

M54530  <  T ) 

0. 1454 

44 

TSK296  <  T ) 

0.0237 

45 

H431 30 ( T ) 

-.0713 

46 

M42732 ( T ) 

0.0530 

47 

TSK288 ( T ) 

0. 1798 

48 

M2  3 1 32 ( T ) 

0.1648 

49 

M27131 (T) 

0.0829 

50 

M42333 ( T ) 

0.0277 

23 

24 

1.0000 

0.5290 

1 .0000 

0.7280 

0,5807 

1 .0000 

0=2351 

0:0339 

0 , 0902 

0.1755 

0.1551 

0.2437 

0.0402 

0.0727 

0.1482 

0.0344 

0.0574 

0.1723 

0.0451 

0.0660 

0.1556 

0.2027 

0.2074 

0. 1384 

0.2112 

0.2301 

0.1148 

0.1241 

0.1162 

0.1701 

0.0229 

0.0177 

0.1754 

0.1371 

0.1366 

0.2416 

0.1414 

0.2286 

0.2011 

0.0912 

0.2299 

0.2752 

0.0213 

-.0190 

0.1360 

0.1278 

0.0568 

0.1198 

0.0554 

-.0648 

0.0335 

0.0915 

-.0933 

0.1232 

0. 1631 

0.0127 

0.2002 

0.1414 

- .0552 

0.1839 

0.0771 

-.0744 

0.0812 

0.0489 

-.0809 

0.0381 

0.0121 

-, 1057 

0.1142 

0.1278 

CO 

■hJ 

o 

0.1198 

0.3351 

-.0129 

0.2431 

0.2118 

0.0710 

0.2046 

0.3927 

0.0361 

0. 1692 

0.0772 

-.0478 

0.2317 

Table  2  (continued) 


1 ,0000 
-.1628 
-.1215 
-.0803 
-.1106 
-.0609 
- . 0867 
0.0406 
0.0760 
-.0695 
0 . 0097 
-.0391 
-.0274 
-. 1819 
-.0689 
0.0150 
- . 0404 
-.0511 
0.0056 
-.0986 
0.0211 
-  .1819 
0.2128 
0.0934 
0.1405 
-.0806 
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26 


27 


2B 


29 


30 


26 

M30230 ( T  > 

1.0000 

27 

M3033 1 <  T ) 

0.8825 

1 .0000 

28 

M30333 ( T ) 

0.9078 

0.9273 

1 .0000' 

29 

M30430  <  T ) 

0.9020 

0.9314 

0.9485 

1 .0000 

30 

M67231 ( 1) 

0.0173 

-. 1138 

- ,0426 

0.0132 

1 .0000 

31 

M67232 ( T ) 

0.0420 

-.0872 

-.0166 

0.0255 

0.9703 

32 

M20230 ( T ) 

0.2972 

0.2944 

0.2933 

0.3304 

0.2132 

33 

H20530 ( T ) 

0.3244 

0.3082 

0.3359 

0.3232 

0.2085 

34 

M  2  0  8  3  0  <  T  ) 

-.0075 

0.0201 

0.0209 

0.0432 

0 . 0905 

35 

M25 1 30 (  T ) 

0.3233 

0.3005 

0.3057 

0.3374 

0 . 2094 

36 

M  46330 ( T ) 

0.4629 

0.5829 

0.5437 

0.5811 

0.0013 

37 

M46230<T) 

0.3990 

0.4088 

0.4035 

0.3982 

-.0613 

38 

M20430  <  T ) 

0.3412 

0.2844 

0.2716 

0.39Q7 

0 . 2908 

39 

M54 1 30  <  T  ) 

0.2612 

0.3222 

0.3121 

0.3566 

0.0205 

40 

M54230  <  T ) 

0.2686 

0.2822 

0.2935 

0.3329 

0.0562 

41 

M5423KT) 

0.3316 

0.3682 

0.3792 

0.4306 

0. 1274 

42 

H54232  <  T ) 

0.4099 

0.3982 

0.4266 

0.4259 

-.0239 

43 

M 54530(1) 

0.3762 

0.3649 

0 . 3842 

0.4  209 

-.0594 

44 

TSK296  <  T ) 

0.1449 

0.2119 

0.2129 

0 . 2268 

0.0834 

45 

M  4  3 1 3  0  (  r  > 

0.2918 

0.3197 

0.3590 

0 . 3833 

0. 1033 

46 

M42732  <  T ) 

0.3412 

0.2844 

0.2716 

0.3987 

0.2908 

47 

TSK28S ( T ) 

0.2101 

0.0892 

0.1301 

0. 1529 

0.2002 

48 

M23 1 32 ( T ) 

0.3661 

0.2963 

0.3392 

0.3768 

0. 1339 

4? 

M27131 (T) 

0. 1129 

0.0330 

-.0069 

0 . 0077 

0 . 1 730 

50 

M42333 ( T ) 

0.3803 

0.4314 

0.4  320 

0.4455 

-  .0260 

31 

32 

33 

34 

35 

31 

M67232 ( T ) 

1.0000 

32 

M20230 ( T ) 

0.2220 

1.0000 

33 

M20530 ( T ) 

0.2120 

0.8868 

1  .  0000 

34 

M20830 ( T  > 

0.0942 

0.4765 

0.5012 

1 .0000 

35 

ii  2  5 1 3 0  (  T  > 

0.2238 

0.9443 

0.8951 

0.4913 

1 . 0000 

36 

M  4  6  3  3  0  <  i  ) 

-.0220 

0 . 2663 

0.7068 

0.0971 

C . 2820 

37 

M46230 ( T  ) 

-.0502 

0 . 4040 

0.3/58 

0.0767 

0.3398 

38 

(120430 ( T ) 

0.2471 

0.3300 

0.2655 

0 . 2037 

0 . 3239 

39 

M541 30 ( T ) 

0.0305 

0.2226 

0.2075 

0.0393 

0. 1820 

40 

M  5  4  2  3  0  <  T  ) 

0.0731 

0.3687 

0.3351 

0.0668 

0.3124 

41 

M  5  4  2  3 1  (  T  > 

0. 1249 

0.3755 

0.31 0  7 

0 . 1535 

0 . 3313 

42 

(154237  (  I) 

-.0110 

0.3003 

0 . 3003 

0.0523 

0 . 2  6  7  0 

43 

(1545  30  <  T ) 

-.0925 

0 . 3204 

0.3108 

0 . 0747 

0.2956 

44 

T  SK296 ( T ) 

0.0969 

0 . 2866 

0.3065 

0. 1472 

0.2606 

45 

M43130(T) 

0.0635 

0.24 78 

0 , 2729 

0 . 0  79>) 

0.2152 

46 

M  4  2  7  3  2  (  1 ) 

0.2471 

0 . 3300 

0.2655 

0 . 2037 

0 . 3239 

47 

TSK28C  <  T ) 

0. 1609 

0. 1263 

C-j 

o 

o 

-.0292 

0.0955 

48 

h  2  3132(1 ) 

0.0997 

0. 1708 

0.2067 

0.0387 

0. 1702 

49 

(127131  (T) 

0. 1935 

0, 17  97 

0. 1739 

0 .030  / 

0. 14  77 

50 

M4233  ^T) 

-.0671 

0 , 2 r  •  1  /, 

0  .  •‘‘5::' 

0  1  ’1  6 

•  7414 

Table  2  (continued) 

162 


36 

37 

38 

39 

40 

36 

M46330  <  T ) 

1.0000 

37 

M46230 ( T ) 

0.6112 

1 .0000 

38 

M20430 ( T ) 

0.3813 

0.4774 

1 .0000 

39 

M54 130(1) 

0.5444 

0.7852 

0.5BS4 

1 .0000 

40 

M54230 ( T ) 

0.5048 

0.7958 

0.5653 

0.8904 

1 .0000 

41 

M5423KT) 

0.6386 

0.7642 

0 . 5635 

0.8307 

0.8792 

42 

H54232 ( T ) 

0.4644 

0.8214 

0.5153 

0.8658 

0.8527 

43 

M54530 ( T ) 

0.5188 

0.7582 

0.5634 

0.7566 

0.7268 

44 

TSK296 ( T ) 

0.5032 

0.7363 

0.5019 

0.8630 

0.8318 

45 

M43 1 30 ( T ) 

0.4403 

0.6523 

0.61 56 

0.7 198 

0.7157 

46 

M42732 ( T ) 

0.3813 

0.4774 

1.0000 

0.5834 

0.5653 

47 

T8K288  <  T ) 

0.2588 

0.3415 

0.4970 

0.3989 

0 .438? 

48 

M231 32  <  T ) 

0.4617 

0.5834 

0.7558 

0.6922 

0.6513 

49 

M27131 <T) 

0.0927 

0.3607 

0.4696 

0.4174 

0.4667 

50 

M42333 ( T ) 

0.4411 

0.7077 

0.5852 

0.7053 

0 . 6004 

41 

42 

43 

44 

45 

41 

H5423KT) 

1.0000 

42 

M54232(T) 

0.8202 

1.0000 

43 

M54530 ( T ) 

0.7398 

0.8281 

1 .0000 

44 

TSK296 ( T ) 

0.7796 

0.8398 

0.7224 

1.0000 

45 

M43130<  T ) 

0.6776 

0.7629 

0.7280 

0.7239 

1 .0000 

46 

M42732 ( T ) 

0.5635 

0.5153 

0 . 5634 

0.501? 

0.615  6 

47 

TSK208  < T ) 

0.3950 

0.3852 

0 . 3868 

0,3189 

0.3735 

48 

M  2  3 1. 3  2  <  T  ) 

0.6165 

0.6257 

0 . 6655 

0.5142 

0.6655 

49 

fi  2  7131  <  1) 

0.3579 

0.3770 

0.2728 

0.3767 

0 . 2462 

50 

M42333  <  T  > 

0.6358 

0 . 7693 

0.6402 

0.6592 

0.7713 

46 

47 

48 

4? 

50 

46 

M  4  2  7  3  2  (  T  ) 

1 .0000 

47 

TSK238 ( T ) 

0.4970 

1 .0000 

48 

M23132CT) 

0 . 7558 

0.6208 

1.0000 

49 

M2713KT) 

0.4696 

0.6636 

0.4870 

1 .0000 

50 

M42333  < T) 

0.5852 

0.3981 

0.5777 

0.3225 

1 .0000 

Table  2  (concluded) 


TABLE  1 

Statistics  for  Various  Forecasting  Schemes 


STATE  SPACE  FORECAST 


48  OBSERVATIONS*  1  SERIES 
RANGE  =JAN  73  -DEC  76 


DIFFERENCING  PERFORMED 

SERIES  REGULAR  SEASONAL 

F30230  0*  0* 

*  AUTOMATIC  DIFFERENCING 


THE  FOLLOWING  ARE  THE  ELEMENTS  OF  THE  STATE  VECTOR 
CANONICAL 


CORRELATION  1.0000 
CHI  SQUARE  9999.99 
D .  F .  3 

INF.  CRIT.  9993.99 
F30230  <  T ) 


STATE  VECTOR  DIMENSION 


IS  AT  LEAST 


1 


CANONICAL 

CORRELATION  1.0000 
CHI  SQUARE  9999.99 
D .  F .  6 

INF.  CRIT.  9987.99 


0.2882 

3.90 

o 

-.10 


NEGATIVE  INFORMATION  CRITERION  ELIMINATES  VARIABLE 
FROM  USE  AT  HIGHER  LEADS  IN  STATE  VECTOR 


F  MATRIX 

1 

ROUS 

1  COLUMNS 

ROW 

1 

-.0065 

H  MATRIX 

1 

ROUS 

1  COLUMNS 

ROW 

1 

1.0000 

G  MATRIX 

1 

ROWS 

1  COLUMNS 

ROW 

1 

1.0000 

RESIDUAL 

MEAN  VECTOR 

1 

ROWS 

1  COLUMNS 

ROW 

1 

-.1186 

RESIDUAL 

COVARIANCE 

MATRIX 

1 

ROUS 

1  COLUMNS 

ROW 

1 

7.6515 

GOODNESS 

OF  FIT 

ORIGINAL  DATA 

DIFFERENCED 

DATA 

<  1  D .  F  .  ) 

2.135 

2.135 

R  SQUARED 

TEST 

ORIGINAL  DATA 

DIFFERENCED 

DATA 

F 30 2 30 

0. 00  21. 3 

0. 00233 

Table  2:  State  Space  Model  for  F30230 
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DIFFERENCING  IT 

;  RF UR MFD 

SERIES 

F1  ■  ‘li  AR 

SEASONAL 

F  6  7  2  3 1 

0* 

0* 

*  AUTOMATIC  D 1 

1 ERt NC ING 

THE  FOLLOWING  ARE  THE  ELEMENTS  OF  THE  STATE  VECTOR 


CANON  I C  Al 
CORRELATION 
CHI  SQUARE 

D.F. 

INF.  CRIT. 
F67231 (T> 
STATE  VECTOR 


1 .OOOV 
999>7 , yy 

4 

9991 .99 
DIMENSION 


IS  AT  LEAST 


1 


CANONICAL 
CORRELATION 
CHI  SQUARE 
D.F. 

INF.  CRIT. 
F6723KT  +  1) 
STATE  VECTOR 


1.0000 

9999.99 
8 

9983.99 


DIMENSION 


0. 3414 
6.23 
3 

0.23 


IS  AT  LEAST 


CANONICAL 

CORRELATION  1.0000  0.3702  0.3235 

CHI  SQUARE  9999.99  11.35  4.86 

D.F.  12  6  2 

INF.  CRIT.  9975.99  -.65  0.86 

NEGATIVE  INFORMATION  CRITERION  ELIMINATES  VARIABLE 

FROM  USE  AT  HIGHER  LEADS  IN  STA  E  VECTOR 


1 


F  MATRIX 

2  ROUS 

ROW  1 

ROU  2 


2  COLUMNS 

0.0000  1.0000 

-.1463  1.0013 


H  MATRIX 

1  ROUS 

ROU  1 


2  COLUMNS 

1.0000  0.0000 


G  MATRIX 

2  ROWS 

ROU  1 

ROU 


1  COLUMNS 
1.0000 
0.4592 


RESIDUAL  MEAN  VECTOR 

1  ROWS  1  COLUMNS 

ROU  1  0.1704 


RESIDUAL  COVARIANCE  MATRIX 

1  ROWS  1  COLUMNS 

ROW  1  7.5085 


GOODNESS  OF  FIT 
(  3  D.F.) 


R  SQUARED  1EST 
I  6/2.'.  1 


ORIGINAL  DATA 
23.497 

ORIGIN.',!  DAI  A 
0.  *v.-  i  , 


DIFFERENCED  DATA 
23.497 

lur  r  lei  hc  n  data 

<> .  ;  •.< 


Table  3:  State  Space  Model  for  F67731 
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seasonal 

o* 

*  AUTOMATIC  DIFFERENCING 

THE  FOLLOWING  ARE  THE  ELEMENTS  OF  I  HE  STATE  VECTOR 
CANONICAL 

CORRELATION  I. 0000 

CHI  SQUARE  9999.99 

D.F.  3 

INF.  CRIT.  9993.99 

F20230(T) 

STATE  VECTOR  DIMENSION  IS  AT  LEAST  1 

CANONICAL 

CORRELATION  1.0000  0.3569 

CHI  SQUARE  9999.99  6.00 

D.F.  6  2 

INF.  CRIT.  9987.99  2.00 

F20230 ( T  +  1) 

STATE  VECTOR  DIMENSION  IS  AT  LEAST  2 

CANONICAL 

CORRELATION  1.0000  0.3627  0.0221 

CHI  SQUARE  9999.99  6.16  0.02 

D.F.  9  4  1 

INF.  CRIT.  9981.99  -1.84  -1.98 

NEGATIVE  INFORMATION  CRITERION  ELIMINATES  VARIABLE 

FROM  USE  AT  HIGHER  LEADS  IN  STATE  VECTOR 


F  MATRIX 

2  ROUS  2  COLUMNS 

ROW  1  0.0000  1.0000 

ROW  2  -.2820  -.3754 

H  MATRIX 

1  ROWS  2  COLUMNS 

ROW  1  1.0000  0.0000 

G  MATRIX 

2  ROWS  1  COLUMNS 

ROW  1  1.0000 

ROW  2  -.5451 

RESIDUAL  MEAN  VECTOR 

1  ROWS  1  COLUMNS 

ROW  1  0.0508 

RESIDUAL  COVARIANCE  MATRIX 

1  ROWS  1  COLUMNS 

ROW  1  6.0265 

GOODNESS  OF  FIT  ORIGINAL  DATA  DIFFERENCED  DATA 

(  3  D.F.)  72.193  28.591 


R  r.OIIAKI.D  1 1'.'!  I  URIGINAI  U.YIA  Oil,!,  .  .  ■  1 

F  20230  O.tUODA  v>.:.70Vo 

Table  4:  State  Snace  Model  for 


D IFFERENC I NG  FF  RT OK MED 
SERIES  REGULAR 
F20230  1* 
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STATE  SPACE  FORECAST 


48  OBSERVATIONS!.  1  SERIES 
RANGE  =  JAN  73  -DEC  76 


DIFFERENCING 

SERIES 

PERFORMED 
•  REGULAR 

SEASONAL 

F  46330 

0* 

0* 

*  AUTOMATIC 

DIFFERENCING 

THE  FOLLOWING  ARE  THE 

ELEMENTS  OF  THE 

STATE  VECTOR 

CANONICAL 
CORRELATION 
CHI  SQUARE 
D.F. 

INF.  CRIT. 
F46330 ( T ) 
STATE  VECTOR 

1.0000 

9999.99 

3 

9993.99 

DIMENSION 

IS  AT  LEAST 

1 

CANONICAL 

CORRELATION 

1.0000 

0.2750 

CHI  SQUARE 

9999.99 

3.54 

D.F. 

6 

2 

INF.  CRIT. 

9987.99 

-.46 

NEGATIVE  INFORMATION  CRITERION  ELIMINATES  VARIABLE 
FROM  USE  AT  HIGHER  LEADS  IN  STATE  VECTOR 


F  MATRIX 

1  ROWS 

1  COLUMNS 

ROW  1 

0.3536 

H  MATRIX 

1  ROWS 

1  COLUMNS 

ROW  1 

1.0000 

G  MATRIX 

1  ROWS 

1  COLUMNS 

ROW  1 

1.0000 

RESIDUAL  MEAN  VECTOR 

1  ROWS 

1  COLUMNS 

ROW  1 

-.0119 

RESIDUAL  COVARIANCE  MATRIX 

1  ROWS 

1  COLUMNS 

ROW  1 

35.530S 

GOODNESS  OF  FIT 

ORIGINAL  DATA 

DIFFERENCED  DATA 

(  1  D.F.) 

4.429 

4.429 

R  SQUARED  TEST  ORIGINAL  DATA 

F 4 63 30  0,  I 


DIFFERENCED  DATA 

0.12536 


Table  5:  State  Space  Model  for  F46330 
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STATE  SPACE  FORECAST 


48  OBSERVATIONS.  1  SERIES 
RANGE  = JAN  73  -DEC  76 


DIFFERENCING 

SERIES 

PERFORMED 

REGULAR 

SEASONAL 

F46230 

0* 

0* 

*  AUTOMATIC 

DIFFERENCING 

THE  FOLLOWING  ARE  THE  ELEMENTS  OF  THE 

STATE  VECTOR 

CANONICAL 
CORRELATION 
CHI  SQUARE 
D.F. 

INF.  CRIT. 
F46230  <  T ) 
STATE  VECTOR 

1.0000 

9999.99 

3 

9993.99 

DIMENSION 

IS  AT  LEAST 

1 

CANONICAL 

CORRELATION 

1.0000 

0.1841 

CHI  SQUARE 

9999.99 

1.55 

D.F. 

6 

2 

INF.  CRIT. 

9987.99 

-2.45 

NEGATIVE  INFORMATION  CRITERION  ELIMINATES  VARIABLE 
FROM  USE  AT  HIGHER  LEADS  IN  STATE  VECTOR 


F  MATRIX 

1  ROUS 

1  COLUMNS 

ROW  1 

0.6229 

H  MATRIX 

1  ROUS 

1  COLUMNS 

ROW  1 

1.0000 

G  MATRIX 

1  ROWS 

1  COLUMNS 

ROW  1 

1.0000 

RESIDUAL  MEAN  VECTOR 

1  ROWS 

1  COLUMNS 

ROW  1 

0.1126 

RESIDUAL  COVARIANCE 

!  MATRIX 

1  ROWS 

1  COLUMNS 

ROW  1 

5.0383 

GOODNESS  OF  FIT 

ORIGINAL  DATA 

DIFFERENCED  DATA 

<  1  D.F.) 

25.587 

25.587 

R  SQUARED  TEST 

ORIGINAL  DATA 

DIFFERENCED  DATA 

F46230 

0.43714 

0.43714 

Table  6:  State  Space  Model  for  F46230 
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STATE  SPACE  FORECAST 


48  OBSERVATIONS.  1  SERIES 
RANGE  = JAN  73  -DEC  76 


DIFFERENCING 

PERFORMED 

SERIES 

REGULAR 

SEASONAL 

F20430 

1* 

0* 

*  AUTOMATIC 

DIFFERENCING 

THE  FOLLOWING  ARE  THE 
CANONICAL 

ELEMENTS  OF  THE  STATE  VECTOR 

CORRELATION 

1.0000 

CHI  SQUARE 

9999.99 

D.F. 

3 

INF.  CRIT. 
F20430  <  T ) 

9993.99 

STATE  VECTOR 

DIMENSION 

IS  AT  LEAST  1 

CANONICAL 

CORRELATION 

1.0000 

0.1183 

CHI  SQUARE 

9999.99 

0.62 

D.F. 

6 

2 

INF.  CRIT. 

9987.99 

-3.38 

NEGATIVE  INFORMATION  CRITERION  ELIMINATES  VARIABLE 
FROM  USE  AT  HIGHER  LEADS  IN  STATE  VECTOR 


F  MATRIX 

1  ROWS 

ROW  1 

H  MATRIX 

1  ROWS 

ROW  1 

G  MATRIX 

1  ROWS 

ROW  I 


I  COLUMNS 
-.1666 


1  COLUMNS 

1 .0000 


1  COLUMNS 

1 .0000 


RESIDUAL  MEAN  VECTOR 

t  ROWS  1  COLUMNS 

ROW  1  0.0737 

RESIDUAL  COVARIANCE  MATRIX 

1  ROWS  1  COLUMNS 

ROW  1  2.3940 


GOODNESS  OF  FIT 

ORIGINAL  DATA 

DIFF  ERFNCED 

DATA 

<  1  D.F.) 

117.150 

3.668 

ft  SQUARED  TEST 

OR I  GINA!  PAT  A 

Dll  F  !  Rf  Ni  F  1' 

F'AT  A 

r 204 30 

o  •  v.-o 

l>  .  1  i 

Table  7:  Srate  Soace  Model  for  F204TO 
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Table  8:  State  Space  Model  for  F43130 
STATE  SPACE  FORECAST 


TIONSf  1  SERIES 
73  -DEC  76 


•;g  performed 

REGULAR  SEASONAL 

0*  3* 

iZ  DIFFERENCING 

I NG  ARE  THE  ELEMENTS  OF  THE  STATE  VECTOR 

•N  1.0000 
I  9999.99 
5 

9989.99 

'OR  DIMENSION  IS  AT  LEAST  1 


jN  1.0000  0.3923 

■£  9999.99  6.85 

10  A 

.  9979.99  -1.15 

INFORMATION  CRITERION  ELIMINATES  VARIABLE 
-',T  HIGHER  LEADS  IN  STATE  VECTOR 


ROUS  1  COLUMNS 

1  -.1382 


ROUS  1  COLUMNS 

1  1 . 0000 


ROUS  1  COLUMNS 

1  1.0000 

■•EAN  VECTOR 
ROUS  1  COLUMNS 

1  0.0129 

COVARIANCE  MATRIX 
ROUS  1  COLUMNS 

1  2.8036 

OF  FIT  ORIGINAL  DATA  DIFFERENCED  DATA 

10.077  -1.06° 

■-FIT  -  RELATIVE  GUO  UN  t.  5.  ■  Of  til  IS  NLGAIFVt 


TEST  ORIGINAL  DATA  DIFF FRF  NEED  DATA 

0.23538  0.02088 


STATE  SPACE  FORECAST 


48  OBSERVATIONS.  1  SERIES 
RANGE  =  JAN  73  -DEC  76 

DIFFERENCING  PERFORMED 

SERIES  REGULAR  SEASONAL 

F42732  1*  0* 

*  AUTOMATIC  DIFFERENCING 

THE  FOLLOWING  ARE  THE  ELEMENTS  OF  THE  STATE  VECTOR- 
CANONICAL 

CORRELATION  1.0000 
C HI  SOUARE  9999.99 

D  .  F  .  3 

INF.  CRIT.  9993.99 

F42732 ( T ) 

STATE  VECTOR  DIMENSION  IS  AT  LEAST  1 

CANONICAL 

CORRELATION  1.0000  0.1620 

CHI  SQUARE  9999.99  1.17 

D .  F .  6  2 

INF.  CRIT.  9987.99  -2.83 

NEGATIVE  INFORMATION  CRITERION  ELIMINATES  VARIABLE 
FROM  USE  AT  HIGHER  LEADS  IN  STATE  VECTOR 


F  MATRIX 

1  ROWS  1  COLUMNS 

ROW  1  -.1753 

H  MATRIX 

1  ROWS  1  COLUMNS 

ROW  1  1 , 0000 

G  MATRIX 

1  ROWS  1  COLUMNS 

ROW  1  1.0000 

RESIDUAL  MEAN  VECTOR 

1  ROWS  1  COLUMNS 

ROW  1  0.0250 

RESIDUAL  COVARIANCE  MATRIX 

1  ROWS  1  COLUMNS 

ROW  1  1.2902 

GOODNESS  OF  FIT  ORIGINAL  DATA  DIFFERENCED  DATA 

<  1  D.F.)  92.123  0.502 

R  SQUARED  TEST  ORIGINAL  DATA  DIFFERENCED  DATA 

F  427,52  0.86507  0.05185 


Table  9:  State  Space  Model  for  F42732 


2 


STATE  SPACE  FORECAST 


48  OBSERVATIONS  *  1  SERIES 

RANGE  = JAN  73  -DEC  76 


DIFFERENCING 

SERIES 

PERFORMED 

REGULAR 

SEASONAL 

TSK287 

1* 

0* 

*  AUTOMATIC 

DIFFERENCING 

THE  FOLLOWING  ARE  THE 

ELEMENTS  OF  THE 

STATE  VECTOR 

CANONICAL 
CORRELATION 
CHI  SQUARE 
D.F. 

INF.  CRIT. 

TSK287 ( T ) 
STATE  VECTOR 

1 .0000 

9999.99 

3 

9993.99 

DIMENSION 

IS  AT  LEAST 

1 

CANONICAL 

CORRELATION 

1.0000 

0.1397 

CHI  SQUARE 

9999.99 

0.87 

D.F. 

6 

o 

INF.  CRIT. 

9987.99 

-3. 13 

NEGATIVE  INFORMATION  CRITERION  ELIMINATES  VARIABLE 
FROM  USE  AT  HIGHER  LEADS  IN  STATE  VECTOR 


F  MATRIX 

1 

ROWS 

1  COLUMNS 

ROW 

1 

-.2276 

H  MATRIX 

1 

ROWS 

1  COLUMNS 

ROW 

1 

1.0000 

G  MATRIX 

1 

ROWS 

1  COLUMNS 

ROW 

1 

1 .0000 

RESIDUAL 

MEAN  VECTOR 

1 

ROUS 

1  COLUMNS 

ROW 

1 

0.0214 

RESIDUAL 

COVARIANCE 

MATRIX 

1 

ROWS 

1  COLUMNS 

ROW 

1 

0.9224 

GOODNESS 

OF  FIT 

ORIGINAL  DATA 

DIFFERENCED 

DATA 

(  1  D.F.) 

119.595 

2.073 

P  SQUARED 

TEST 

ORIGINAL  DATA 

DIFFERENCED 

DA  I  A 

TSK207 

0 . 92476 

0  .  O'Jj.oO 

Table  10:  State  Space  Model  for  TSK287 


urn  F  Rf  NC  I  Mi;  I  F  KF  *'1[,  MF  P 

SFLiE  K1  >.1U  AK  CEACCKV.t 

F  5 4  1  L>  j*  , 

*  AU TOMA  JIT  1 1 1 r  F f RFNC I NO 


THE  FOLLOWING  ARE  r  Ht  E  l  E  Ml.  NT  S  OF'  THE  STATE  VECTOR 
CANON T  CAT 


CORRCLA  I  I  ON 

1 .0000 

CHI  SQUARE 

9999. 99 

D.E. 

3 

INE.  CR1T. 

9993.99 

E  5  4 1  3  0  (  T  ) 
STATE  VECTOR 

DIMENSION  IS  AT  LEAST 

1 


CANONICAL 
COLRE L AT  I  ON 

I .0000 

0.3408 

CHI  SQUARE 

9999 . 99 

5.43 

D.F. 

6 

2 

INF.  CRIT. 

9987 . 99 

1  .  43 

F54 1 30  <  T  4  1) 
STATE  VECTOR 

DIMENSION 

IS  AT  LEAST 

CANONICAL 

COKKTLAT  TUN  1.0000 
CHI  SQUALL  W9.V9 

d.f  .  ? 


0.3647  0.1547 

7.26  1.05 

4  1 


INF.  CL  t  T  .  9981.99  -.74  -.95 

NEGATIVE  INFORMATION  CL  I T  EL  I  ON  ELIMINATES  VARIABLE 

FROM  USE  A 1  HIGHER  LEADS  IN  STATE  VECTOR 


1 


F  MATRIX 

2  ROWS 

ROW  1 

ROW  2 


2  COLUMNS 

J .0000  1.0000 

-.1307  -.0450 


H  MATRIX 

1  LOWS 

ROW  1 

G  MATRIX 

2  ROWS 

ROW  1 

ROW  2 


2  COLUMNS 

1.0000  0.0000 


1  COLUMNS 
1 .0000 
- . 4554 


RESIDUAL. 

1 

ROW 

RESIDUAL 

1 

ROW 

GOODNESS 
<  3  D.I  .  ) 

L  SOU, -Li  D 

F 54 1 30 


MEAN  VECTOR 
ROWS  1  CHI UMNS 

1  0.2  I  BE. 

CO VAR  I ANl  F  MAIL  I* 

LOWS  1  COLUMNS 

1  V . 5050 

OF  FIT  OR  I  GINA!  DA T  0 

5,6  .  'VS! 

TIM  (II,  1 1.  I  NC  PC  '• 

0. 7 33 93 


D I EFE RENTED  DATA 
6. 5"  4 

I'll  I  I  LI  (VI  D  IV,  1  A 
0 .23409 


Table  11:  State  Snare  Model  for  FV.130 


inr terenc.  ins  fekt  urml  d 

SERIFS  RE  C;  I  It  Ah'  SEASONAL 

E23132  1*  °* 


*  AUTOMATIC  DIFFERENlING 


THE  FOLLOWING  ARE  THE  ELEMENTS  OF  THE  STATE  VECTOR 


CANON ICA1 
CORRELATION 
CHI  SQUARE 
D.F. 

INF.  CRIT. 

F23 1 32 ( T ) 
STATE  VECTOR 

1.0000 

9999.99 

3 

9993.99 

DIMENSION 

IS  AT  LEAST 

1 

CANONICAL 

CORRELATION 

1 .0000 

0.3283 

CHI  SQUARE 

9999.99 

5.02 

D.F. 

6 

o 

INF.  CRIT. 

9987.99 

1.02 

F23132  <  T+  1) 
STATE  VECTOR 

DIMENSION 

IS  AT  LEAST 

r> 

CANONICAL 

CORRELATION 

1.0000 

0.3658  0.0974 

CHI  SQUARE 

9999.99 

6.66  0.41 

D.F. 

9 

4  1 

INF.  CRIT. 

9981 .99 

-1.34  -1.59 

NEGATIVE  INFORMATION  CRITERION  ELIMINATES 

VARIABLE 

FROM  USE  AT  HIGHER  LEAHS  IN  STATE  VECTOR 


F  MATRIX 

2  ROUS 

ROW  1 

ROU  2 


2  COLUMNS 

0.0000  1.0000 

-.3366  -.6699 


H  MATRIX 

1  ROUS 

ROU  1 


2  COLUMNS 

1.0000  0.0000 


G  MATRIX 

2  ROUS 

ROU  1 

ROU  2 


1  COLUMNS 
1.0000 
-.1738 


RESIDUAL  MEAN  VECTOR 

1  ROl.  1  COLUMNS 

ROW  1  0.0577 


RESIDUAL  COVARIANCE  MATRIX 

1  ROUS  1  COLUMNS 

ROU  1  0.9939 


GOODNESS  OF  FIT 
<  3  D .  F  ) 

R  S(Jl  I,  *1- 1  D  IF',  I 

F  2  3 1 3  2 


ORIGINAL  DATA 
109.500 

ORIGIN.', I  DA  I  A 
0.91435 


DIFFERENCED  DATA 
5. 731 

D I  I  I  I  I  ;  NCI  D  DA i A 
0.2 2009 


Table  12:  Slate  Space  Model  for  F23132 


STATE  SPACE  FORECAST 


48  OBSERVATIONS,  1  SERIES 
RANGE  = JAN  73  -DEC  76 

DIFFERENCING  PERFORMED 

SERIES  REGULAR  SEASONAL 

F27131  1*  0* 

*  AUTOMATIC  DIFFERENCING 


THE  FOLLOWING  ARE  THE  ELEMENTS  OF  THE  STATE  VECTOR 
CANONICAL 


CORRELATION 
CHI  SQUARE 
D.F. 

INF.  CRIT. 
F27131 ( T ) 
STATE  VECTOR 


1 .0000 

9999.99 
3 

9993.99 
DIMENSION 


IS  AT  LEAST 


1 


CANONICAL 
CORRELATION 
CHI  SQUARE 
D.F. 

INF.  CRIT. 


1.0000 

9999.99 
6 

9987.99 


0.1322 

0.78 


-3.22 

NEGATIVE  INFORMATION  CRITERION  ELIMINATES  VARIABLE 
FROM  USE  AT  HIGHER  LEADS  IN  STATE  VECTOR 


F  MATRIX 

1 

ROWS 

1  COLUMNS 

ROW 

1 

-.2202 

H  MATRIX 

1 

ROWS 

1  COLUMNS 

ROW 

1 

1.0000 

G  MATRIX 

1 

ROWS 

1  COLUMNS 

ROW 

1 

1 .0000 

RESIDUAL 

MEAN  VECTOR 

1 

ROWS 

1  COLUMNS 

ROW 

1 

0.0210 

RESIDUAL 

COVARIANCE 

MATRIX 

1 

ROWS 

1  COLUMNS 

ROW 

1 

0.8329 

GOODNESS 

OF  FIT 

ORIGINAL  DATA 

DIFFERENCED 

DATA 

<  1  D.F.) 

120.409 

2.016 

R  SQUARED 

TEST 

ORIGINAL  DATA 

DIFFERENCED 

DATA 

F  2  7  i  /  1 

(>,'•’  2  A  06 

0.08189 

Table  13:  State  Space  Model  for  F27131 


STATE  SPACE  FORECAST 


48  OBSERVATIONS,  1  SERIES 
RANGE  = JAN  73  -DEC  76 

DIFFERENCING  -PERFORMED 

SERIES  REGULAR  SEASONAL 

F42333  0*  0* 

*  AUTOMATIC  DIFFERENCING 

THE  FOLLOWING  ARE  THE  ELEMENTS  OF  THE  STATE  VECTOR- 


CANONICAL 

CORRELATION 

1 .0000 

CHI  SQUARE 

9999.99 

D.F, 

3 

INF.  CRIT. 

9993.99 

F42333 ( T ) 
STATE  VECTOR 

DIMENSION  IS  AT  LEAST 

1 

CANONICAL 

CORRELATION 

1.0000  0.1054 

CHI  SQUARE 

9999.99  0.50 

D.F. 

6  2 

INF.  CRIT. 

9987.99  -3.50 

NEGATIVE  INFORMATION  CRITERION  ELIMINATES  VARIABLE 
FROM  USE  AT  HIGHER  LEADS  IN  STATE  VECTOR 


F  MATRIX 

1 

ROWS 

1  COLUMNS 

ROW 

1 

0.7244 

H  MATRIX 

1 

ROWS 

1  COLUMNS 

ROW 

1 

1 .0000 

G  MATRIX 

1 

ROWS 

1  COLUMNS 

ROW 

1 

1 .0000 

RESIDUAL 

MEAN  VECT 

OR 

1 

ROWS 

1  COLUMNS 

ROW 

1 

-.0100 

RESIDUAL 

COVARIANC 

E  MATRIX 

1 

ROWS 

1  COLUMNS 

ROW 

t 

1 . 3778 

GOODNESS 

OF  FIT 

ORIGINAL  DATA 

D IFF ERENCED 

(  1  D.F.) 

36.988 

36 . 988 

R  SQUARED 

TEST 

ORIGINAL  DATA 

DIFFERENCED 

F 42333 

0  ♦  5  5  6 1  u 

0.55615 

STATE  SPACE  FORECAST 


48  OBSERVATIONS?  1  SERIES 
RANGE  = JAN  73  -DEC  76 


DIFFERENCING  PERFORMED 
SERIES  REGULAR 
M30230  1* 


SEASONAL 

0# 


*  AUTOMATIC  DIFFERENCING 


THE  FOLLOWING  ARE  THE  ELEMENTS  OF  THE  STATE  VECTOR 
CANONICAL 

CORRELATION  1.0000 
CHI  SQUARE  9999.99 
D  .  F  .  3 


INF.  CRIT. 

M30230 ( T  > 
STATE  VECTOR 


9993.99 

DIMENSION  IS  AT  LEAST 


1 


CANONICAL 
CORRELATION 
CHI  SQUARE 
D.F. 

INF.  CRIT 


1.0000 

9999.99 
6 

9957.99 


0.2373 


1 .41 


NEGATIVE  INFORMATION  CRITERION  ELIMINATES  VARIABLE 
FROM  USE  AT  HIGHER  LEADS  IN  STATE  VECTOR 


F  MATRIX 

1  ROUS 

ROW  1 

H  MATRIX 

1  ROWS 

ROW  1 

G  MATRIX 

1  ROWS 

ROW  1 


1  COLUMNS 
-.3790 


1  COLUMNS 

1.0000 


1  COLUMNS 

1 .0000 


RESIDUAL 
ROW 

RESIDUAL 
ROW 

GOODNESS  QF  FIT 
(  1  Ii .  r .  > 

f<  SOI  ITiKI  D  II.  C.  1 
M 3 0  2  3  0 


MATRIX 

1  COLUMNS 
1  .  3SB7 

ORIGtNA!  DATA 

47.730 

NR  1  0  1  N.  1  DA  I  i. 
0.64923 


DIFFERENCE D  r'ATA 
6. 40  4 

Dll  f  l  .'•!  N  I"',  i  I 
0 . 1 6373 


MEAN  VECTOR 

1  ROUS  1  COLUMNS 

1  0.0312 

COVARIANCE 
1  ROWS 
1 


Table  15:  State  Space  Nedel  Tor  >130210 


STATE  SPACE  FORECAST 


48  OBSERVATIONS*  1  SERIES 
RANGE  =  JAN  73  -BEL'  76 

DIFFERENCING  PERFORMED 

SERIES  REGULAR  SEASONAL 

M67231  0*  0* 

*  AUTOMATIC  DIFFERENCING 

THE  FOLLOWING  ARE  THE  ELEMENTS  OF  THE  STATE  VECTOR 
CANONICAL 

CORRELATION  1.0000 
CHI  SQUARE  9999.99 
D .  F  .  8 

INF.  CR IT .  9983.99 

M67231 <T) 

STATE  VECTOR  DIMENSION  IS  AT  LEAST  1 

CANONICAL 

CORRELATION  1.0000  0,5033 

CHI  SQUARE  9999.99  12.41 

D.F.  16  7 

INF.  CRIT.  9967.99  -1.59 

NEGATIVE  INFORMATION  CRITERION  ELIMINATES  VARIABLE 
FROM  USE  AT  HIGHER  LEAPS  IN  ST<  TE  VECTOR 


F  MATRIX 

1  ROWS  1  COLUMNS 

ROW  1  0.5454 

H  MATRIX 

1  ROUS  1  COLUMNS 

ROW  1  1 . 0000 

G  MATRIX 

1  ROUS  1  COLUMNS 

ROW  1  1.0000 

RESIDUAL  MEAN  VECTOR 

1  ROWS  1  COLUMNS 

ROW  1  -.0393 

RESIDUAL  COVARIANCE  MATRIX 

1  ROWS  1  COLUMNS 

ROW  1  2.8177 

GOODNESS  OF  FIT  ORIGINAL  DATA  DIFFERENCED  DATA 

<  1  D.F.)  16.051  16.051 

R  SQUARED  TEST  ORIGINAL  DATA  DIFFERENCED  DATA 

M6/231  0.31344  0.31344 


Table  16:  State  Space  Model  for  M672J1 


17° 


STATE  SPACE  FORECAST 


48  OPSERVA  T  I ONS  *  1  SERIES 

RANGE  -JAN  73  -DEC  76 

differencing’ PERFORMED 

SERIES  REGULAR  SEASONAL 

M20230  1*  0* 

*  AUTOMATIC  DIFFERENCING 

THE  FOLLOWING  ARE  THE  ELEMENTS  OF  THE  STATE  VECTOR 


CANONICAL 

CORREI-A  I  ION 

1 . 0000 

CHI  SOU ARE 

9999.99 

D.E. 

3 

INE.  CRIT. 

9993.99 

M20230 ( I) 
state  VECTOR 

DIMENSION 

IS  AT  LEAST 

CANONICAL 

CORREI.A  I  ION 

I .0000 

0.1088 

CHI  SQUARE 

9999.99 

0.52 

D.E. 

6 

o 

INF.  CRIT. 

9987.99 

-3. 43 

NEGATIVE  INFORMATION  CRITERION  ELIMINATES  VARIABLE 
FROM  USE  AT  HIGHER  LEADS  IN  STATE  VECTOR 


F  MATRIX 

I 

ROUS 

1  COLUMNS 

ROW 

1 

-.2255 

H  MATRIX 

1 

ROUS 

).  COLUMNS 

ROW 

1 

1.0000 

G  MATRIX 

1 

ROWS 

1  COLUMNS 

ROW 

1 

1.0000 

RESIDUAL 

MEAN  VECTOR 

1 

ROWS 

1  COLUMNS 

ROW 

1 

0.0538 

RESIDUAL 

COVARIANCE 

MATRIX 

1 

ROWS 

1  COLUMNS 

ROW 

1 

2.9879 

GOODNESS 

OF  FIT 

ORIGINAL  data 

DIFFERENCED 

DATA 

(  1  H .  F  .  ) 

70.399 

1 , 971 

R  SQUARED 

TEST 

ORIGINAL  DATA 

DIFFERENCED 

DATA 

M20230 

0.70570 

0.08101 

Table  17:  State  Space  Model  for  M20230 
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STATE  SPACE  FORECAST 


4;  OBSERVATIONS*  1  SERIES 
RANGE  =  JAN  73  -BEC  76 

DIFFERENCING* PERFORMED 

SFRIES  REGULAR  SEASONAL 

M46330  0*  0* 

*  AUTOMATIC  DIFFERENCING 

THE  FOLLOWING  ARE  THE  ELEMENTS  OF  THE  STATE  VECTOR- 


CANONICAL 

CORRELATION 

1.0000 

CHI  SQUARE 

9979.99 

D.F. 

3 

INF.  CRIT. 

9993.99 

M46330  <  T  > 
STATE  VECTOR 

DIMENSION 

IS  AT  LEAST 

CANONICAL 

CORRELATION 

1.0000 

0.2298 

CHI  SQUARE 

9999.99 

2.44 

D.F. 

6 

n 

INF.  CRIT. 

9987.99 

-1.56 

NEGATIVE  INFORMATION  CRITERION  ELIMINATES  VARIABLE 
FROM  USE  AT  HIGHER  LEADS  IN  STATE  VECTOR 


F  MATRIX 

1  ROWS 

ROW  1 

1  COLUMNS 
0.6663 

H  MATRIX 

1  ROWS 

ROW  1 

1  COLUMNS 
1.0000 

G  MATRIX 

1  ROWS 

ROW  1 

1  COLUMNS 
1.0000 

RESIDUAL  MEAN  VECTOR 

1  ROWS  1  COLUMNS 

ROW  1  0.0939 

RESIDUAL  COVARIANCE  MATRIX 

1  ROWS  1  COLUMNS 

ROW  1  5.1793 

GOODNESS  OF  FIT 
<  1  D.F.) 

ORIGINAL  DATA 
28.362 

DIFFERENCED 
28 . 3o2 

DATA 

R  SQUARED  TEST 
M46330 

ORIGINAL  DATA 
0.46077 

DIFFERENCED 

0.46077 

DATA 

Table  18:  State  Space  Model  for  MA6330 
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STATE  SPACE  FORECAST 


48  OBSERVATIONS,  1  SERIES 
RANGE  = JAN  73  -DEC  76 

DIFFERENCING  PERFORMED 

SERIES  REGULAR  SEASONAL 

M46230  1*  0* 

*  AUTOMATIC  DIFFERENCING 


THE  FOLLOWING  ARE  THE  ELEMENTS  OF  THE  STATE  VECTOR 
CANONICAL 


CORRELATION 

1.0000 

CHI  SQUARE 

9999.99 

D.F. 

3 

INF.  CRIT. 

9993.99 

M46230 ( T  ) 
STATE  VECTOR 

DIMENSION  IS  AT  LEAST 

1 


CANONICAL 

CORRELATION  1.0000  0.1271 

CHI  SQUARE  9999.99  0.72 

D.F.  6  2 

INF.  CRIT.  9987.99  -3.28 

NEGATIVE  INFORMATION  CRITERION  ELIMINATES  VARIABLE 
FROM  USE  AT  HIGHER  LEADS  IN  STATE  VECTOR 


1 


F  MATRIX 

1 

ROWS 

1  COLUMNS 

ROW 

1 

-.3199 

H  MATRIX 

1 

ROWS 

1  COLUMNS 

ROW 

1 

1 .0000 

G  MATRIX 

1 

ROWS 

1  COLUMNS 

ROW 

1 

1.0000 

RESIDUAL 

MEAN  VECTOR 

1 

ROUS 

1  COLUMNS 

ROW 

1 

0.0273 

RESIDUAL 

COVARIANCE 

MATRIX 

1 

ROWS 

1  COLUMNS 

ROW 

1 

1.7226 

GOODNESS 

OF  FIT 

ORIGINAL  DATA 

DIFFERENCED 

DATA 

(  1  D.F.) 

87.440 

3.941 

R  SQUARED 

TEST 

ORIGINAL  DATA 

DIFFERENCED 

DATA 

M46230 

0.85008 

0.11875 

Table  19:  State  Space  Model  for  Mm6230 
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Table  20:  State  Space  Model  for  M20430 
STATE  SPACE  FORECAST 


48  OBSERVATIONS*  1  SERIES 
RANGE  = JAN  73  -DEC  76 

DIFFERENCING  PERFORMED 

SERIES  REGULAR  SEASONAL 

M20430  1*  0* 

*  AUTOMATIC  DIFFERENCING 

THE  FOLLOWING  ARE  THE  ELEMENTS  OF  THE  STATE  VECTOR 
CANONICAL 

CORRELATION  1.0000 
CHI  SQUARE  9999.99 

D.F.  3 

INF.  CRIT.  9993.99 

M20430  <  T ) 

STATE  VECTOR  DIMENSION  IS  AT  LEAST  1 

CANONICAL 

CORRELATION  1.0000  0.1811 

CHI  SQUARE  9999.99  1.47 

D.F.  6  2 

INF.  CRIT.  9987.99  -2.53 

NEGATIVE  INFORMATION  CRITERION  ELIMINATES  VARIABLE 
FROM  USE  AT  HIGHER  LEADS  IN  STATE  VECTOR 


F  MATRIX 

1  ROWS  1  COLUMNS 

ROW  1  -.0618 

H  MATRIX 

1  ROWS  1  COLUMNS 

ROW  1  1.0000 

G  MATRIX 

1  ROWS  1  COLUMNS 

ROW  1  1.0000 

RESIDUA!  MEAN  VECTOR 

1  ROWS  1  COLUMNS 

ROW  1  0.0270 

RESIDUAL  COVARIANCE  MATRIX 

1  ROWS  1  COLUMNS 

ROW  1  1.4692 

GOODNESS  OF  FIT  ORIGINAL  DATA  DIFFERENCED  DATA 

(  1  D.T  .  )  100.640  -.737 

PU.iR  MODI  I  I  1  '  R'  l  'MVi  r ,|H Hi; >t  or  FI  I  IS  NFi.AlT'T 


ORIGINAL  DAI  A 
0.9.)  SO  2 

18} 


R  SOIIARKD  TEST 
M20430 


DIF  I  F  F,l  NCI  D  DATA 
0.0. 'AS:' 


STATE.  Sf  ACC  FORECAST 


48  OBSERVAT  I ONS »  1  SE  RIES 

RANGE  =  JAN  73  -DEC  76 

DIFFERENCING.  FT. RFORMED 

SERIES  REGULAR  SEASONAL. 

M43130  1*  0* 

*  AUTOMATIC  DIFFERENCING 


THE  FOLLOWING  ARE  THE  ELEMENTS  OF  THE  STATE  VECTOR 
CANONICAL 

CORRELATION  1.0000 
CHI  SQUARE  9999.99 
D  .  F  .  3 


INF.  CRIT.  9993.99 
M4313CMT ) 

STATE  VECTOR  DIMENSION  IS  AT  LEAST  1 


CANONICAL 


CORREI  A  I ION  1.0000 

CHI  SQUARE  9999.99 
D  .  F  .  6 

INF.  CRII.  9987.9? 
NEGATIVE  INFORMATION  CR 


0.1744 

1.36 


-2.64 

ITERION  ELIMINATES  VARIABLE 


ERUM  USE  AT  HIGHER  LEADS  IN  STATE  VECTOR 


1 


F  MATRIX 

1 

ROWS 

1  COLUMNS 

ROW 

1 

-.2180 

H  MATRIX 

t 

ROWS 

1  COLUMNS 

ROW 

1 

1 .0000 

G  MATRIX 

1 

ROWS 

1  COLUMNS 

ROW 

i 

l  .0000 

RESIDUAL 

MEAN  VE 

C  TOR 

1 

ROWS 

1  C01  LIMNS 

ROW 

X 

0 . 0268 

RESIDUAL 

COVARIANCE  MATE  1 X 

1 

ROWS 

1  COLUMNS 

ROW 

1 

0.6544 

GOODNESS 

nr  fit 

ORIGINAL  DAT  ■ 

<  1  D  .  F  .  ) 

1 28 . 509 

R  SQUARED 

TEST 

ORIGINAL  DA  T  i 

M43130 

0.93776 

DIF  EL  REN!  D  DATA 
2.537 

DIFFERENCED  DATA 
0.09202 


TabK  21:  Sl.iu-  Space  Model  toi  M43130 
184 


SI  ATE  SPACE  TURF  LAST 


48  OBSERVATIONS.  1  SERIES 
RANGE  -JAN  73  -DEC  76 

DIFFERENCING" PERFORMED 

SERIES  REGULAR  SEASONAL 

M42732  1*  0* 

*  AUTOMATIC  DIFFERENCING 

THE  FOLLOWING  ARE  THE  ELEMENTS  OF  THE  STATE  UECTOR 
CANONICAL 

CORRELATION  1.0000 
CHI  SQUARE  9999.9? 

D  .  F  .  3 

INF.  CRIT.  9993.99 

M42732  <  T ) 

STATE  VECTOR  DIMENSION  IS  AT  LEAST  1 

CANONICAL 

CORRELATION  1.0000  0.1811 

CHI  SQUARE  9999.99  1.47 

D .  F .  6  2 

INF.  CRIT.  9987.99  -2.53 

NEGATIVE  INFORMATION  CRITERION  ELIMINATES  VARIABLE 
FROM  USE  AT  HIGHER  LEADS  IN  STATE  VECTOR 


F  MATRIX 

1  ROWS 

1  COLUMNS 

ROW 

1 

-.0618 

H  MATRIX 

1  ROWS 

1  COLUMNS 

ROW 

1 

1 .0000 

G  MATRIX 

1  ROWS 

1  COLUMNS 

ROW 

1 

1 .0000 

RESIDUAL 

mean  vfo 

TOR 

1  ROWS 

1  COLUMNS 

ROW 

0.0270 

RES I  DUAL 

CGVARiA.v 

A  A  T’ATRi> 

1  ROWS 

1  COLUMNS 

ROW 

1 

1  .  46^2 

GOODNESS 

or  f  n 

OR  i  0 1 NAI  DA  i 

POOR  MODI  I  FIT  Rfl.ATIVF.  GOODNESS  Of  F  IT  IS  NEF.AT 


STATE  SPACE  FORECAST 


48  OBSERVATIONS,  1  SERIES 
RANGE  = JAN  73  -DEC  76 

DIFFERENCING' PERFORMED 

SERIES  REGULAR  SEASONAL 

TSN288  1*  0* 


*  AUTOMATIC  DIFFERENCING 

THE  FOLLOWING  ARE  THE  ELEMENTS  OF  THE  STATE  VECTOR 
CANONICAL 

CORRELAT ION  1 . OOOO 

CHI  SQUARE  9999.99 
D  .  F .  3 

INF.  CRIT.  9993.99 
TSK2S8 ( T ) 

STATE  VECTOR  DIMENSION  IS  AT  LEAST  1 


CANONICAL- 


CORRELATION  1.0000 
CHI  SQUARE  9999. .99 
D .  F  .  6 


0.1448 

0.93 


INF.  CRIT.  9987.99  -3.07 

NEGATIVE  INFORMATION  CRITERION  ELIMINATES 

FROM  USE  AT  HIGHER  LEADS  IN  STATE  VECTOR 


VARIABLE 


1 


F  MATRIX 

1 

ROWS 

1  COLUMNS 

ROW 

1 

0.1159 

H  MATRIX 

1 

ROWS 

1  COLUMNS 

ROW 

1 

1 ,0000 

G  MATRIX 

1 

ROWS 

1  COLUMNS 

ROW 

1 

1 .0000 

RESIDUAL 

MEAN 

VECTOR 

1 

ROWS 

1  COLUMNS 

ROW 

1 

0.0265 

RESIDUAL  COVARIANCE 

MATRIX 

1  ROWS 

1  COLUMNS 

ROW  1 

0.6838 

GOODNESS  OF  FIT 

ORIGINAL  DATA 

DIFFERENCED 

DATA 

(  1  D  .  F  ,  ) 

111 .587 

0.588 

R  SQUARED  TEST 

ORIGINAL  DATA 

DIFFERENCED 

DATA 

TSK288 

0.91079 

0 . 05357 

Table-  23:  State  Space  M-cL'l  for  TSK2S7 
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STATE  SPACE  FORECAST 


48  OBSERVATIONS*  1  SERIES 
RANGE  -  JAN  73  -  DEC  76 

DIFFERENCING  PERFORMED 

SERIES  REGULAR  SEASONAL 

M54130  1*  0* 

*  AUTOMATIC  DIFFERENCING 

THE  FOLLOWING  ARE  THE  ELEMENTS  OF  THE  STATE  VECTOR- 
CANONICAL 

CORRELATION  1.0000 
CHI  SQUARE  9999.99 

D  .  F  .  3 

INF.  CRIT.  9993.99 

M54130<T) 

STATE  VECTOR  DIMENSION  IS  AT  LEAST  1 

CANONICAL 

CORRELATION  1.0000  0.1753 

CHI  SQUARE  9999.99  1.37 

D .  F .  6  2 

INF.  CRIT.  9987.99  -2.63 

NEGATIVE  INFORMATION  CRITERION  ELIMINATES  VARIABLE  1 

FROM  USE  AT  HIGHER  LEADS  IN  STATE  VECTOR 


F  MATRIX 

1  ROWS  1  COLUMNS 

ROW  1  -.2504 

H  MATRIX 

1  ROWS  1  COLUMNS 

ROW  1  1.0000 

G  MATRIX 

1  ROWS  1  COLUMNS 

ROW  1  1.0000 

RESIDUAL  MEAN  VECTOR 

1  ROWS  1  COLUMNS 

ROW  1  0.0508 


RESIDUAL  COVARIANCE  MATRIX 

1  ROWS  1  COLUMNS 

ROW  1  3.9261 


GOODNESS  OF 
<  1  D  .  F  .  ) 

FIT 

ORIGINAL 
121 . 402 

DATA 

DIFFERENCED  DATA 
2.657 

R  SOIIA'-!  n  11 

•ST 

OR  IS  1  f 

DATA 

Dim  Rl  NCI  li  DATA 

MS  T  1  'O 

V  ♦  V 

, ;  > 

0  .  <>'  ID 

Table  24:  State  Space  Model  for  M54 ! 30 


state:  space:  forecast 


4  S  0  B  S  F  R  V  A  T  I  0  NS  .  1  s  e:  R  I  E  s 

RANGE  -JAN  75  -DEC  76 

Li  I F  F  E  R  E  N  C I N  G '  F  E  R  F  0  R  MED 

SERIES  REGULAR  SEASONAL 

M23132  1*  °* 

*  AUTOMATIC  DIFFERENCING 

THE  FOLLOWING  ARE  THE  ELEMENTS  OF  THE  S  T  A  T  _  VECTOR 
CANONICAL 

CORRELATION  1.0000 
CHI  SOU ARE  9999.9? 

D  .  F  .  3 

INF,  CRIT.  9993,99 
M  2  3 1  3  2  l  T  > 

STATE  VECTOR  DIMENSION  IS  AT  LEAST  1 

CANONICAL 

CORRELATION  1.0000  0.2712 


CHI  S  QUART 

9999. 

99  3 . 36 

D  .  F  . 

6 

INF.  CRIT 

993  7. 

??  -.64 

NEGATIVE 

INFORM AT  I 

ON  CRITERION  EILI  MINUTES  vnK  I  nbLt 

FROM  USE 

AT  HIGHER 

LEADS  IN  STATE 

VECT OR 

F  MATRIX 

1 

ROUS 

i  COLUMNS 

ROW 

1 

0.1773 

H  MATRIX 

1 

ROWS 

1  COLUMNS 

ROW 

1 

1 .0000 

G  MATRIX 

.1 

ROWS 

1  COLUMNS 

ROW 

1 

1 . 0000 

RESIDUAL 

MEAN  VECTOR 

1 

X 

ROWS 

1  COLUMNS 

ROW 

1 

0.0261 

RES  I  DiJTil 

L  AVAR  I!  ANL 

.  E  nAIRI* 

.1 

ROWS 

1  COLUMNS 

R  0  Li 

1 

0 , 9003 

G  0  0  DM"1'.  S 

OF  FIT 

LJ  R  I  S  l  N  i'i  L  i 1 A  ;  0 

DIET  E  i  i  NEED  I'M  I  A 

(  1  D  .  f  •  ) 

134 . 770 

i .  3 1 

R  SNIJAFEI 

i  TEST 

OR 10  INAL  DA  1  A 

DIF  FER!  ..FED  RAT  A 

me *;:• 

0.9  V. 'LL 

0  .  (C  ■  Si  1 

MICROCOPY  RESOLUTION  TEST  CHART 

NATIONAL  BUREAU  Of  ST  AND  ARDS  VRfe.l  A 


STATE  SPACE  FORECAST 


48  OBSERVATIONS*  1  SERIES 


RANGE  = JAN  73 

-DEC  76 

DIFFERENCING 

PERFORMED 

SERIES 

REGULAR 

SEASONAL 

M27131 

1* 

0* 

*  AUTOMATIC  DIFFERENCING 

THE  FOLLOWING  ARE  THE  ELEMENTS  OF  THE  STATE  VECTOR 


CANONICAL 

CORRELATION 

1.0000 

CHI  SQUARE 

9999.99 

D.F. 

3 

INF.  CRIT. 

9993.99 

M2713KT) 
STATE  VECTOR 

DIMENSION 

IS  AT  1 

CANONICAL 

CORRELATION 

1.0000 

0.2066 

CHI  SQUARE 

9999.99 

1.92 

D.F. 

6 

2 

INF.  CRIT. 

9987.99 

-2.08 

NEGATIVE  INFORMATION  CRITERION  ELIMINATES  VARIABLE  1 

FROM  USE  AT  HIGHER  LEADS  IN  STATE  VECTOR 


F  MATRIX 

1 

ROWS 

1  COLUMNS 

ROW 

1 

0.2106 

H  MATRIX 

1 

ROWS 

1  COLUMNS 

ROW 

1 

1,0000 

G  MATRIX 

1 

ROWS 

1  COLUMNS 

ROW 

1 

1.0000 

RESIDUAL 

MEAN  VECTOR 

1 

ROWS 

1  COLUMNS 

ROW 

1 

0.0286 

RESIDUAL 

COVARIANCE 

:  MATRIX 

1 

ROWS 

1  COLUMNS 

ROW 

1 

0.5110 

GOODNESS 

OF  FIT 

ORIGINAL  DATA 

DIFFERENCED 

DATA 

<  1  D.F’.) 

128.312 

2.865 

R  SQUARED 

TEST 

ORIGINAL  DATA 

DIFFERENCED 

DATA 

M27131 

0.937U0 

0.09034 

state:  space  forecast 


48  OBSERVATIONS,  1  SERIES 
RANGE  = JAN  73  -DEC  76 

DIFFERENCING  PERFORMED 

SERIES  REGULAR  SEASONAL 

M42333  1*  0* 

*  AUTOMATIC  DIFFERENCING 


THE  FOLLOWING  ARE  THE  ELEMENTS  OF  THE  STATE  VECTOR 


CANONICAL 

CORRELATION  1.0000 
CHI  SQUARE  9999.99 
D .  F .  3 

INF.  CRIT.  9993.99 


M42333<  T ) 

STATE  VECTOR  DIMENSION  IS  AT  LEAST 


1 


CANONICAL 

CORRELATION  1.0000  0.0956 
CHI  SQUARE  9999.99  0.40 


D.F.  6  2 

INF.  CRIT.  9987.99  -3.60 

NEGATIVE  INFORMATION  CRITERION  ELIMINATES  VARIABLE 
FROM  USE  AT  HIGHER  LEADS  IN  STATE  VECTOR 


F  MATRIX 

1  ROUS 

1  COLUMNS 

ROW  1 

-.3049 

H  MATRIX 

1  ROWS 

1  COLUMNS 

ROW  1 

1.0000 

G  MATRIX 

1  ROUS 

1  COLUMNS 

ROW  1 

1.0000 

RESIDUAL  MEAN  VECTOR 

1  ROWS 

1  COLUMNS 

ROW  1 

0.0260 

RESIDUAL  COVARIANCE 

:  MATRIX 

1  ROWS 

1  COLUMNS 

ROW  1 

0.6386 

GOODNESS  OF  FIT 

ORIGINAL  DATA 

DIFFERENCED  DATA 

<  1  D.F.) 

120.939 

4.734 

R  SQUARED  TEST 

ORIGINAL  DATA 

DIFFERENCED  DATA 

M42333 

0.92689 

0. 13349 

Table  27:  State  Space  Model  for  M42333 
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Figure  B.l.  Plot  of  One  Step  State  Space  Prediction  for  F30230  and 
Observed  Data  Over  Fit  Set 
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Figure  B.2.  Plot  of  12-Month  State  Space  Prediction  and  Actual  Observed 
Data  of  F30230  for  1977 
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Figure  B.4.  Plot  of  12-Month  State  Space  Prediction  and  Actual  Observed 
Data  of  F67231  for  1977 
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Figure  B.5.  Plot  of  One  Step  State  Space  Prediction  for  F20230  and 
Observed  Data  Over  Fit  Set 
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Figure  B.6.  Plot  of  12-Month  State  Space  Prediction  and  Actual 
Observed  Data  of  F20230  for  1977 
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Figur  ' ct  of  One  Step  State  Space  Prediction  for  F46330  and 

served  Data  Over  Fit  Set 
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Figure  B.8.  Plot  of  12-Month  State  Space  Prediction  and  Actual 
Observed  Data  of  F46330  for  1977 
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Figure  B.9.  Plot  of  One  Step  State  Space  Prediction  for  F46230  and 
Observed  Data  Over  Fit  Set 
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Figure  B.10.  Plot  of  12-Month  State  Space  Prediction  and  Actual 
Observed  Data  of  F46230  for  1977 
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Figure  B.ll.  Plot  of  One  Step  State  Space  Prediction  for  F20430  and 
Observed  Data  Over  Fit  Set 
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Figure  B.12.  Plot  of  12-Month  State  Space  Prediction  and  Actual 
Observed  Data  of  F20430  for  1977 
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Figure  B.13.  Plot  of  One  Step  State  Space  Prediction  for  F43130  and 
Observed  Data  Over  Fit  Set 
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Figure  B.14.  Plot  of  12-Month  State  Space  Prediction  and  Actual 
Observed  Data  of  F43130  for  1977 
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Figure  B.15.  Plot  of  One  Step  State  Space  Prediction  for  F42732  and 
Observed  Data  Over  Fit  Set 
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Figure  B.17.  Plot  of  One  Step  State  Space  Prediction  for  TSK287  and 
Observed  Data  Over  Fit  Set 
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Figure  B.18.  Plot  of  12-Month  State  Space  Prediction  and  Actual 
Observed  Data  of  TSK287  for  1977 
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Figure  B. 19 .  Plot  of  One  Step  State  Space  Prediction  for  F54130  and 
Observed  Data  Over  Fit  Set 
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Figure  B.20.  Plot  of  L2-Month  State  Space  Prediction  and  Actual 
Observed  Data  of  F54I30  for  1977 
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Figure  B.22,  Plot  of  12-Month  State  Space  Prediction  and  Actual 
Observed  Data  for  F23I32  for  1977 
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Figure  B.23.  Plot  of  One  Step  State  Space  Prediction  for  F27131  and 
Observed  Data  Over  Fit  Set 
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Figure  B.24.  Plot  of  12-Month  State  Space  Prediction  and  Actual 
Observed  Data  for  F27131  for  1977 
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Figure  B.25.  Plot  of  One  Step  State  Space  Prediction  for  F42333  and 
Observed  Data  Over  Fit  Set 


F=F42333 
2=F42333P 
3=F42333PU 
4=F42333PL 
+  -- 

85.5  + 


84.0  + 


82.5+2 


81.0  + 


79.5  + 


78.0  + 


-~ -+ - + - + - + - + - + - + - + - + - i - H 


3  3 


3  3  3  3  3  3  3 


F  F 


76.5+  + 

+ - + - +• . 4- —  + - + - + - + - + - 4 - + - 4 - 4 

JAN  FEB  MAP  APR  MAY  J  UN  JUL  AUG  SEP  OCT  NOU  MFC  JAN 

197 7  197 7  1977  1977  19 77  1977  1977  1977  1977  1977  1977  1977  1978 


Figure  B.26.  Plot  of  12-Month  State  Space  Prediction  and  Actual 
Observed  Data  for  F42333  for  1977 
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Figure  B.27.  Plot  or  One  Step  State  Space  Prediction  for  M30230  and 
Observed  Data  Over  Fit  Set 
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Figure  B.30.  Plot  of  12-Month  State  Space  Prediction  and  Actual 
Observed  Data  of  M67231  for  1977 
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Figure  B.31.  Plot  of  One  Step  State  Space  Prediction  for  M20230  and 
Observed  Data  Over  Fit  Set 
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Figure  B.32.  Plot  of  12-Month  State  Space  Prediction  and  Actual 
Observed  Data  of  M20230  for  1977 
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Figure  B.33.  Plot  of  One  Step  State  Space  Prediction  for  M46330  and 
Observed  Data  Over  Fit  Set 
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Figure  B.34.  Plot  of  12-Montb  State  Space  Prediction  and  Actual 
Observed  Data  of  M46330  for  1977 
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Figure  B.35.  Plot  of  One  Step  State  Space  Prediction  for  M46230  and 
Observed  Data  Over  Fit  Set 
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Figure  B.36.  Plot  of  12-Month  State  Space  Prediction  and  Actual 
Observed  Data  of  M46230  for  1977 
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Figure  B.37.  Plot  of  One  Step  State  Space  Prediction  for  M20430  and 
Observed  Data  Over  Fit  Set 
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Figure  B.38.  Plot  of  12-Month  State  Space  Prediction  and  Actual 
Observed  Data  for  M20430  for  1977 
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Figure  B.39.  Plot  of  One  Step  State  Space  Prediction  for  M43130  and 
Observed  Data  Over  Fit  Set 


229 


w  K)  3: 


=M431 30 
■M43130P 
= M  4  3 1  30PU 
4=M431 30PL 

+ - + - + - + - + - + - + - + - + - + - + - ^ - + 

111,+  + 


108. + 


105. + 


102. + 


’  2 

99. +M 


96.+ 


M 

4 


n 

aL 

M 


M 


M 


M 

4 


*7  O 


M  M  M 


3  3 


r>  r> 


M 


4  4  4  4  4 


93.+  + 

+ - + - + - + - + - + - f - + - i - + - + - + - + 

JAN  FEB  MAR  APR  MAY  JUN  JUl.  AUG  SEP  OCT  NOO  DEC  JAN 

1977  1977  1977  1977  1977  1977  1977  1977  1977  1977  1977  1? 77  1978 


Figure  B.40.  Plot  of  12-Month  State  Space  Prediction  and  Actual 
Observed  Data  of  M43130  for  1977 
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Figure  B.41.  Plot  of  One  Step  State  Space  Prediction  for  M42732  and 
Observed  Data  Over  Fit  Set 
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Figure  B.42.  Plot  of  12-Month  State  Space  Prediction  and  Actual 
Observed  Data  of  M42732  for  1977 
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Figure  B.43.  Plot  of  One  Ste.D  State  Space  Prediction  for  TSK288  and 
Observed  Data  Over  Fit  Set 
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Figure  B.44.  Plot  of  12-Month  State  Space  Prediction  and  Actual 
Observed  Data  for  TSK288  for  1977 
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Figure  B.45.  Plot  of  One  Step  State  Space  Prediction  for  M54130  and 
Observed  Data  Over  Fit  Set 
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Figure  B.46.  Plot  of  12-Month  State  Space  Prediction  and  Actual 
Observed  Data  of  M54130  for  1977 
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Figure  B.47.  Plot  of  One  Step  State  Space  Prediction  for  M23132  and 
Observed  Data  Over  Fit  Set 
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Figure  B.49.  Plot  of  One  Step  State  Space  Prediction  for  M27131  and 
Observed  Data  Over  Fit  Set 
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Figure  B.50.  Plot  of  12-Month  State  Space  Prediction  and  Actual 
Observed  Data  of  M2 7131  for  1977 
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Figure  B.51.  Plot  of  One  Step  State  Snare  Prediction  for  M42333  and 
Observed  Data  OvL  r  Fit  Set 
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Figure  B.52.  Plot  of  12-Month  State  Space  Prediction  and  Actual 
Observed  Data  for  M42333  for  1977 
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APPENDIX  C 


AN  EXTENDED  KALMAN  FILTER  FOR  PJM  TIME  SERIES  DATA 
C.l  Problem  Formulation 

An  extended  Kalman  filter  is  generally  used  in  cases  where  one  of 
the  following  is  present:  (i)  nonlinear  terms  in  the  model;  (ii)  error 
statistics  which  are  nongaussian;  (iii)  parameters  which  are  unknown  and 
time-varying;  or  ( iv)  errors  in  independent  variables. 

The  extended  Kalman  filter  is  an  approximate  filter  for  nonlinear 
systems  which  is  based  on  a  first-order  linearization  method.  It  is  the 
best  known  and  most  often  used  method  of  nonlinear  estimation.  It  has 
the  advantage  of  being  a  very  straightforward  approach  to  nonlinear  esti¬ 
mation  in  that  the  usual  Kalman  filter  can  be  applied  to  the  linearized 
system.  However,  it  suffers  from  several  important  disadvantages.  First, 
it  is  only  a  first-order  method;  consequently,  it  does  not  have  strong 
convergence  properties  in  general  (Nelson  and  Stear,  1976)  .  Ljung  (1977) 
has  given  convergence  conditions  and  suggested  a  modification  of  the  filter 
to  improve  convergence  properties.  Extended  Kalman  filters  are  known  to 
give  biased  estimates  (Orlhac,  Athans,  Speyer  and  Houpt,  197  5)  .  In  this 
appendix,  we  develop  an  extended  filter  applicable  to  the  PJM  problem  and 
compare  it  with  the  adaptive  filter  of  Chapter  7. 

The  data  analysis  and  filter  developments  of  Chapters  3  and  7  have 
indicated  that  condition  (iii),  mentioned  above,  is  the  most  significant 
departure  from  the  Kalman  filter  assumptions.  Hence,  the  extended  Kalman 
filter  for  the  PJM  data  will  be  an  adaptive  filter  designed  to  estimate 
both  the  states  and  system  parameters  at  the  same  time. 

Detailed  analyses  of  PJM  data,  as  discussed  in  Chapter  7,  have  indi¬ 
cated  that  the  most  significant  source  of  modeling  uncertainty  leading 
to  prediction  errors  is  the  uncertainty  in  the  transition  matrix.  For 
this  reason,  the  exposition  below  is  restricted  to  development  of  an  ex¬ 
tended  filter  to  simultaneously  estimate  the  state  and  the  elements  of 
the  transition  matrix. 

Consider  the  problem  of  estimating  simultaneously  the  state  x  and 

t  bi 

the  j  column,  <p . ,  of  the  transition  matrix  $.  The  usual  state  equation 
is  J 

x(i+l)  =  <J>x(i)  +  w(i)  (C.l) 

with  observation 

y(i)  =  Hx( i)  +  r ( i)  (C.2) 

where 

$  =  [4>1  |  ....  i  4>n] 

x,  are  nxl  vectors,  y,  r  are  ra  *  1  vectors  and  w(k) ,  r(k)  are  zero-mean 


uncorreiated  white  noise  processes  with  known  covariance  matrices  W  and  R, 
respectively . 


C .  2 


Extended  Filter  Development 

The  extended  filter  uses  the  augmented 

fxd)  1 


Zj  (i) 


state 


(C.3) 


The  uncertainty  in  will  be  accounted  for  here  by  modeling  <{K(k)  by 

a  Markov  process  of  the  form 


^(i+D 


Aj4>jU)  +  Qj(i) 


(C.4) 


where  A.  is  a  fixed  known  n*n  matrix  and  q,  is  a  zero-mean  white  noise 
J  J 

process  with  known  covariance  matrix  .  It  is  explicitly  assumed  that 

w(i),  r(i)  and  q^(i)  are  uncorrelated. 


to 


The  augmented  state  evolves  as  a  nonlinear  Markov  process  according 


Zj ( i+1)  =  f(Zj(i))  +  uj(i) 

where 


(C.5) 


and 


f(z  (i)) 


k=l 


\(i) 


xk(i) 


(C.  6) 


Uj  (i) 


'w(i) 

q.(i) 

L  J 


(C.7) 


In  the  linear  Gaussian  case,  z^(i+l)  is  a  Gaussian  random  variable  and  tiie 

condition  mean  ('minimum-variance  estimate)  was  found  using  the  Kalman  filter. 
In  the.  nonlinear  case  (Eq.  (C.5)),  the  problem  becomes  more  difficult. 

The  conditional  mean  z.  is 

J 

Zj  (  i+1 1  1)  =  /  f(Zj(i))p(Zj(i))  dz^(i) 


(C .  8) 


where  p(z^(i))  is  the  probability  density  functions  for  z^(i),  given  data 

y  ( 1 ) ,  . . . ,y(i) .  Thus,  in  order  to  compute  z.(i+l|i),  p(z.(i)),  which  is 
•  5  J 

nongaussian  in  general,  must  be  known. 

In  practice,  it  is  not  possible  to  solve  Eq.  (C.8)  and  alternative 
approaches  must  be  sought.  An  attractive  alternative,  which  is  the  basis 
of  the  extended  Kalman  filter,  is  based  on  a  linearization  technique.  The 
dynamical  equation  (C.5)  is  expanded  in  a  Taylor  series  about,  the  prior 
estimate  z.(iji)  as 


z  (i+1)  =  f(z  ( i | i) )  + 


3f  i 


(z.(i)  -  2, ( i | i) )  +  ...  (C.9) 


z  =  Zj(i|  i) 


Taking  the  expectation  of  both  sides  of  Eq.  (C.9)  produces 


z.(i+l|i)  =  f(z.(i[i))  +  0  +  ... 


(C.1C) 


Now  we  use  the  notation 


e j  (  i  |  i)  =  z j  ( i)  -  Zj(i|i) 


v  (i)  =  — 
J  3z 


z  -  z  (i|i) 


(C.ll) 

(C. 12) 


where  e.(iji)  is  the  estimation  error  at  sample  i  using  measurements  up 
to  y ( i) ^  to  write  Eq.  (C.9)  as 


Zj(i+1)  =  f(z  (i| i))  +  ?.(i)e.(i|i) 


(C . 13) 


It  follows  that  the  estimation  error  e . ( i+1 j i)  =  z . (i+1)  -  z . ( i+1 1 i)  has 


mean  zero  ana  covariance  matrix 


P  ,  ( i+1  j  i)  =  .  (  i)  P  .  (  i)T  .  (  i)  +  U. 

J  J  J  j  J 


(C.U) 


where  U.  is  the  covariance  matrix  of  u.(i). 

J  J 

The  measurement  y(i)  is  linear  in  the  states  z^ ( i) : 

y(i)  =  [H  ‘  0]  z^  (  i) 


(C . 1 3) 


and  thus,  the  update  equations  at  a  measurement  are  precisely  those  of  the 
Kalman  filter  (cf.  Eq.  (5.3)  through  (5.11)). 

We  now  summarize  the  complete  set  cf  equations  for  the  extended  Kalman 
filter,  noting  that 


H'jU) 


*(i) 


0 


i 

i 


A. 

J 


(C. 16) 


where  x  (i)  is  the  i**1  component  of  x(i)  and  I  is  the  nxn  identity  ma- 

j  n 

trix.  The  following  notation  will  be  used: 


Pj(i)  =  PjUli-l),  P.(±)  =  P.(i|i) 


and  the  covariance  matrices  will  be  partitioned  as 


P 

PI 

XX 

4>x 

p 

P 

$x 

M  _ 

With  these  definitions,'  the  extended  Kalman  filter  is  as  follows. 


Propagation 

x(i+l |  i)  =  $(i)x(i|i) 

$j(i+l|i)  *  A  $  (i|i);  j  =  l,2 . n 

P’  (i+1)  -  $(i)Pvv  (i)$(i)T  +  $(i)PA  v(i)Tx.(i|i) 

“j  XXj  <PjX  J 

+  Pcb  x<i)^Ci)Tx  <i|i)  +  P  (i)x  (iji)2  +  W 

j  J  J  J  J 

pi.x(i+1)  "  AjYx(1)$(i>T  +  AjY*.(i>*J(i,i) 

J  J  J  J 


(C.17) 

(C.18) 


(C . 19) 

(C . 20) 


p;  0  (i+i> 

j  j 


A.P.  (  i)A .  +  Q 


(C. 21) 


Measurement  Incorporation 

v(i)  =  y ( i+1)  -  Hx(i+l|i)  (C.22) 

x(i+l j i+1)  =  x(i+l|i)  +K  (i+l)v(i+l)  (C.23) 

Xj 

$  (i+1 j i+1)  «$  (i+1 | i)  +K  (i+l)v(i+l)  (C . 24) 

J  J  ‘Pj 

K  (i+D  =  P*  (i+l)HTZ  (i+1)"1  (C . 25) 

X  XX  3 


K  (i+1)  =  p;  v(i+l)HTZ.(i+l)~1 
4  x  j 


(C. 26) 


(C. 27) 


Z  (i+1)  =  HP'  (i+l)HT  +  R 
)  _  xx. 

P  (i+1)  =  [I-K  (i+l)H]P'  (i+1)  (C. 28) 

XX  j  X  XX  j 

P^x(i+1)  =  [I-K^(i+1)H]P^  x(i+l)  (C.29) 

P*  4  <i+1>  "  f1-^  x<i+1>H)p*  4  <i+1>  <C’30> 

Vj  9j  Vi 

$(i+l)  =  [$1(i+l) ;  .  .  .  ;$j(i+l) ;  .  .  .  i$n(i+l)]  (C. 31) 


These  equations  are  predicated  on  updating  the  j  column  of  <I>  only. 
For  updating  all  n  columns,  they  may  be  processed  sequentially  as  follows: 

(i)  Compute  x(i+l|i)  and  v(i). 

(ii)  Evaluate  Eqs.  (C.18)  through  (C.21)  for  j  =  l,2,...,n. 

(iii)  Evaluate  Eqs.  (C.24)  through  (C.30)  for  j  =  l,2,...,n, 
storing  K  ( i+1)  at  each  step. 

Xj 

(iv)  Compute  the  arithmetic  means: 


(v) 


Z(i+1)  =  £  l  Z  (i+1) 
j-1  J 

1  n 

P'  (i+1)  =  -  I  P’  (i+1) 

VY  n  *-  YY 


n  XX. 

1=1  J 

and  the  gain  Kx(i+1)  = Pxx( i+1) H^Z( i+1) 


Update  estimated  $  using  Eq.  (C.31)  and  estimated  x(i+l) 
using  x(i+l|i+l)  = x(i+l | i)  + Kx(i+1) v( i+1) . 


C . 3  Comparison  with  Maximum  Likelihood  Adaptive  Filter 

The  extended  Kalman  filter  of  Eqs.  (C.17)  through  (C.31)  is  much  more 
complex  than  the  adaptive  filter  of  Fig.  7.1,  due  principally  to  the  fact 
that  prior  information  is  included  in  the  extended  filter,  which  is  based 
on  a  Bayesian  formulation.  In  addition,  if  it  is  desired  to  estimate  all 
of  the  columns,  the  complexity  increases  by  about  a  factor  of  n. 

The  relationship  between  the  two  filters  can  be  seen  more  clearly  bv 
neglecting  certain  of  the  terms  in  the  extended  Kalman  filter.  For  up¬ 
dating  the  state,  we  assume 


p  (i)  ^  p.  i  (i), 
xx'  d>  ,<p . 

j  J  J 


P  (i)»P. 

XX  .  <f>  .X 

J  J 


(i) 


Then  Eq.  (C.19)  becomes 


(C. 32) 


P'  ( i+l>  =  0(i)P  (i)$(i)  +  W 

XX  XX 


Since  Z.(i)  becomes  independent  of  j,  Eqs.  (C.17),  (C.22),  (C.23),  (C.27) 

and  (C.32)  comprise  the  usual  Kalman  filter  for  x,  based  on  the  estimated 
transition  matrix  0(i). 

For  estimating  0.(i),  we  now  assume 


P.  (i)»P  (i), 

0  .  <t> .  xx  . 

J  J  1 


0, 


W  =  0 


P  ( i) »  P  (i), 
0.0.  ©  .x 

J  J  J 


A .  *  a .  I , 
J  J 


Then  the  equations  for  estimating  $  become 

0 . (i+1 1 i+1)  =  a .0  .  ( i j i)  +  K.  (i+l)v(i+l)  (C.33) 

J  J  J  ©j 

K  (i+1)  =  a  P  (i)x  (iji)HTZ  (i+l)_1  (C . 34) 

©j  J  j  J 

I .(i+1)  =  Hx.(i|i)P  ( i+1) x . ( i j i) RT  +  R  (C.35) 

3  J  ©j0j  J 

P0  0  <i+1>  =  aj[I"K0  <i+1>HlP0  0  <*>  (C*36> 

j  J  j  j  j 


The  relationship  between  these  equations  and  those  for  the  adaptive 
filter  of  Table  7.1  is  striking.  Note  that  the  equations  for  updating 
0j(i)  become  identical  if,  in  Table  7.1,  we  use  ( i  j i )  rather  than 

x^(i|i-l),  assume  y  -  1  (no  age  weighting),  G  (i)=0  and  set  -  1  in 

Eqs.  (C.33)  through  (C.36). 

Several  studies  have  been  made  of  the  extended  filter  and  its  relation 
to  other  par;,...eter-adnptivc  methods.  Ljur.g  (1977)  showed  thooret ica 1 1 v 
that  the  well-known  divergence  problem  associated  with  the  *  xfvnded  filter 
can  be  traced  to  the  fact  that  the  effort  m  the'  Kalman  gain  of  a  change- 
in  the  parameters  is  not  appropriately  accounted  for.  This  is  particularly 
important  if  the  noise  covariances  change ,  but  is  important  oven  it  they 
do  not.  He  suggested  a  technique  for  mod l i y i nr  the  gain  to  improve  con¬ 
vergence.  However,  this  technique  requires  extensive  computations  and  it 
is  not  yet  clear  that  this  is  warranted  for  the  PJM  problem.  Saridis  (19'..) 
has  compared  the  extended  filter  to  several  other  causal  *  parameter-adaptive 
algorithms.  A  fourth-order  system  was  studied  with  v  in  companion  form 


0 


0  10  0 

0  0  10 

0  0  0  1 

0 ,  0  -*  v .  V  / 

l  2  5  4 


♦Causal  it  y  implies  that  (  i )  is  estimated  i:<;  in-  onl  v  n.t.nt  dita  v(  1  ),...,  v(  i)  . 

1  ... 


and  H=  [1  0  0  0].  The  methods  studied  included  a  non-causal  maximum 

likelihood  method  (Astrom  and  Bohlin,  1965),  a  causal  modification  of  this 
algorithm  (similar  to  the  algorithm  developed  in  Chapter  7),  two  stochas¬ 
tic  approximation  algorithms  and  a  maximum  a  posteriori  probability  fil¬ 
ter  (Cox,  1964).  Of  these,  the  causal  maximum  likelihood  filter  gave  the 
least  mean  squared  errors  in  estimating  the  p.'s.  However,  the  global 
convergence  properties  were  not  quite  as  good^as  the  stochastic  approxi¬ 
mation  algorithms.  It  is  interesting  to  note  that  the  non-causal  al¬ 
gorithm  yielded  no  better  error  performance,  but  required  considerably 
more  computation.  We  emphasize  here  that  non-causal  estimation  is  not 
appropriate  for  the  PJM  problem,  since  our  objective  is  predicting  future 
values  of  the  time  series  of  interest. 

The  above  discussion  indicates  that  there  is  a  tradeoff  between 
robustness  and  performance  in  parameter-adaptive  algorithms.  This  phe¬ 
nomenon  is  quite  well  known  and  appears  to  be  a  universal  characteristic. 
The  design  of  the  most  appropriate  algorithm  for  a  particular  problem 
depends  on  the  problem  itself  and  no  single  adaptive  filter  is  best  for 
all  problems. 

The  conclusion  of  this  appendix  is  that  extended  Kalman  filters  do 
not  appear  to  be  the  most  appropriate  technique  for  parameter  adaptation 
of  PJM  time  series.  For  this  reason,  no  numerical  results  are  given  for 
this  method  in  this  report. 


APPENDIX  D 


ADAPTIVE  FILTERING  TESTS  USING  KNOWN  TIME  SERIES  MODELS 


The  numerical  results  given  in  Chapter  3  were  based  on  prediction  of 
PJM  time  series.  The  performance  measure  was,  of  necessity,  based  entirely 
upon  the  prediction  error  statistics.  Since  the  "true"  dynamical  models 
for  producing  the  PJM  time  series  data  are  unknown,  it  is  not  possible  to 
examine  the  ability  of  the  adaptive  filter  to  correctly  identify  the  dy¬ 
namics  (i.e.,  the  transition  matrix  in  this  case)  using  PJM  data.  We 
may,  of  course,  make  certain  inferences  concerning  the  performance  of  the 
adaptive  filter  from  these  results.  For  example,  we  can  study  stability 
properties  directly  by  varying  y  and  B  and  the  initial  conditions  to  get 
some  idea  of  robustness  and  stability  bounds.  Nevertheless,  a  more  com¬ 
plete  analysis  is  not  possible.  The  properties  of  the  adaptive  filter 
developed  in  Chapter  7  can  be  studied  more  thoroughly  by  using  data 
generated  by  known  dynamical  models. 

The  adaptive  filter  developed  in  Chapter  7  is  an  approximate  maximum- 
likelihood  estimator  for  the  components  of  the  transition  matrix.  A  true 
maximum-likelihood  estimator  produces  estimates  which  are  consistent, 
asymptotically  Gaussian  and  asymptotically  efficient,  under  the  assumption 
that  the  disturbances  are  white  Gaussian  sequences.  It  is  also  necessary 
that  the  system  is  "persistently  excited,”  which  implies  that  all  modes 
of  the  system  are  excited  at  all  times  by  the  white  noise  disturbance. 

As  a  simple  example,  consider  the  system 

x(i+l)  *  <tx(i) 


where 


x(0) 


1 


1 


The  transition  matrix 


b  |  1-b 


yields  x(i) 


[i]  f°' 


ill 


Thus,  with  respect  to  the  given  initial  con¬ 


dition  is  not  uniquely  identifiable  with  no  disturbance  input  since  the 
parameters  a  and  b  .ire  free.  The  state  space  program  discussed  in  Chapter 
5  uses  a  special  canonical  form  for  ».  In  the  two-dimensional  case 
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0  I 

-  t 
b  , 


1 

1-b 


liil 


reducing  the  number  of  free  parameters  to  one.  Ident i f iab il i ty  of  4>  is 
enhanced,  since  there  is  one  instead  of  two  free  parameters.  However, 
both  states  must  be  persistently  excited  to  ensure  identif iability . 

In  this  appendix  we  consider  a  simple  two-dimensional  dynamical 
system.  This  system  was  chosen  to  be  roughly  neutrally  stable  to  match 
qualitatively  the  character  of  PJM  payoff  data.  Changes  are  introduced 
in  the  dynamics,  and  the  signal-to-noise  ratio  is  varied.  Measurements 
of  one  and  then  both  states  are  taken.  Initial  conditions  are  varied  to 
study  the  identif iability  problem.  Sensitivity  to  changes  in  the  Kalman 
gain  is  evaluated  and  the  effects  of  varying  the  adaptation  parameters 
are  studied.  The  overall  result  is  that  the  adaptive  filter  works  quite 
well  and  appears  to  be  quite  robust  to  variations  in  system  parameters. 

D.l  Adaptive  Filter  Algorithm  Tests  on  Completely  Observed  Data 

Here  we  present  tests  using  a  two-dimensional  series  where  both 
states  are  observed  for  a  neutrally  stable  4(t) .  The  series  was  gen¬ 
erated  recursively  by 


x(t+l)  =  4( t+l)x(t)  +  n( t+1) 
IV.  1 


(D.l) 


0 

where  x(0)  =  ^jand  n(t)  Is  pseudo  white  noise,  normally  distributed  with 
zero  mean  and  covariance  matrix 


Q  = 


0.0025  0 

0  0.0025 


°ll 


A  neutrally  stable  4(t)  has  eigenvalues  that  lie  on  the  unit  circle  in 
the  z-plane.  As  the  white  noise  in  the  system  may  render  the  time  series 
unstable,  eigenvalues  of  magnitude  0.99  were  chosen  so  as  to  lie  just 
within  the  unit  circle.  Figure  D.l  shows  the  location  of  the  eigenvalues 
in  the  z-plane  as  a  function  of  0.  The  corresponding  4  matrix  is  given 
by 


<J> 


0  ;  1 

—  —  “  —  — 

-.98  '  1.98cos6 


(D.2) 


0 ( t )  was  varied  every  15  time  periods  in  a  step  manner  by  changing  9  so 
that  $  remained  neutrally  stable.  Values  of  0  chosen  were  72°,  36°,  and 
0° .  The  corresponding  4(t)  obtained  was  used  in  Eq.  (D.l)  to  generate 
time  series  over  45  time  periods.  The  adaptive  filter  was  run  on  the 
series  and  initialized  with  the  following  boundary  conditions: 


*1  o" 

’l  o" 

’.1  .9' 

A(0)  = 

0  1 

,  w  * 

0  1 
u  J 

,  4(0)  =  4(0)  = 

-.7  .8 

u 

The  algorithm  used  was  presented  in  Table  7.1. 


Figure  D.l.  Eigenvalues  of  Neutrally  Stable  £(t)  Varied 
in  a  Step  Manner  from  (1)  to  (2)  to  (3). 

The  parameters  Y  and  S  in  the  algorithm  control  the  speed  of  adapta¬ 
tion.  Several  different  tests  were  implemented  using  the  adaptive  filter 
and  the  results  for  the  one-step-ahead  prediction  errors  are  summarized 
in  Table  D.l.  In  each  case  the  adaptive  root  sun  square  vector  is  de¬ 
rived  for  comparison  with  the  persistence  root  sum  square  vector.  It  is 
clearly  seen  that  the  adaptive  filter  does  a  better  job  than  persistence. 
Cases  (1)  to  (5)  are  tests  using  different  values  for  y  and  $  with  noise 
standard  deviation  of  0.05.  Cases  (1)  and  (.5)  represent  better  choices 

of  y  and  g.  Case  (6)  is  similar  to  Case  (1)  except  that  x(C)  =  1^1 .  Case 

(7)  uses  Y“  .5,  $=  .5  but  with  reduced  a  =  0.025.  As  expected  the  adap- 

is 

tive  filter  performs  better  than  in  Case  (6)  where  cr^  =  0.05.  Case  (8) 

T 

uses  observations  generated  from  v  (t)*  varied  in  the  same  manner  as  in 
the  other  cases.  Note  in  this  case  the  adaptive  filter  does  considerably 
better  than  persistence.  Figures  D.2-D.9  show  the  adaptation  of  the 
elements  of  i>  for  Cases  (6)  and  (7).  In  Figures  D.10-D.25,  the  actual 
states  are  plotted  over  the  45  time  periods  together  with  the  one-step- 
ahead  predicted  states  i'.-r  each  of  the  Cases  (1)  -  (8).  As  expected  from 
comparison  in  Table  D.l,  Cases  (1)  and  (5)  achieve  the  best  one-step- 
ahead  predictions  out  of  the  first  five  cases.  Figures  D.24  and  D.25 

T 

reveal  that  the  system  with  transition  matrix  =  C  in.  Case  (8)  becomes 
unstable;  however,  the  adaptive  filter  tracks  well. 

*Thn  eigenvalues  of  -5(  t)  ar.d  0  (t)  are  identical. 


D.2  Adaptive  Filter  Tests  on  Partially  Observed  Data 


The  properties  of  the  adaptive  filter  of  Chapter  7  were  further 
studied  using  partially  observed  data.  A  two-dimensional  time  series 
was  generated  using  the  model  of  (D.l)  and  (D.2)  with 


Q  =  a 


In  this  case,  however,  only  the  first  component  of  x(t)  was  observed.  As 
in  Section  D.l,  v(t)  was  varied  every  15  tine  periods  in  a  step  manner  by 
changing  6  so  that  i  remained  neutrally  stable.  Various  sets  of  data  wore 
generated  using  (D.l)  with  different  choices  of  9  and  a.  The  adaptive 
filter  was  run  on  these  sets  of  data,  always  initialized  with  the  fol¬ 
lowing  boundary  conditions: 


A(0)  = 


$(0)  = 


-.7  .3 


Note  that  the  adaptive  filter  was  required  to  identify  only  the  elements 
of  the  second  row  of  J>.  The  elements  of  the  first  row  were  set  to  0  and 
1  respectively  to  satisfy  idenoif iability  conditions. 

Test  Cases 

1 .  Noise-free  data:  9=50°,  40°,  30°,  respectively 

(a)  45  data  points  generated  by  decreasing  9  every  15  steps  from  50° 


through  30°.  The  x  vector  in  (D.l)  was  initialized  using  x(0)=! 

Various  combinations  of  y  and  g  were  used  with  the  gain  matrix, 

K  =  j •  Results  appear  in  Table  D.2,  where  it  can  be  seen  that 

the  best  choice  of  parameters  was  y=  .95,  3  =  .95.  A  high  value 
of  y  is  optimal  since  the-  elements  of  the  transition  matrix,  i, 
do  not  change  drastically;  in  fact,  only  5(2,2)  changes  as  2  is 
moved  through  three  10°  steps.  Since  the  data  are  noise-free, 
a  high  value  of  3  is  expected  to  be  optimal  so  taat  the  rate 
of  adaptation  is  high.  Case  5  shows  the  Je-ter  iorat  ion  in  the 
performance  of  the  filter  when  the  gain  matrix,  K,  is  changed 
Cl'S 

to  j  ,  Also  note  t'riat  the  adaptive  filter  does  a  better  job 
than  persistence  prediction  of  x(l). 

(b)  Using  the  same  values  of  6  as  in  (a),  a  second  two-d  im.uns  ion.al 


time  series  was  generated  with  x(0)  = 


which  allows  the 


nitudes  of  the  two  states  to  remain  closer  to  each  other  than 
with  x(0)  =  [  .  The  results  using  this  data  appear  in  Table 


The  results  using  this  data  appear  in  Tablt 


D.3.  Figures  D.26  and  D. 27  show  the  adaptation  of  9(2,1)  and 


<>(2,2)  for  y  =  .9,  8  =  .8.  Note  that  ident  if  iab  il  ity  of  the 
elements  of  5  is  poorer  here  than  in  (a),  since  the  data  have 
less  dynamics  due  to  the  choice  of  x(0). 

2 .  Noisy  daft:  6=50°,  40°,  30°,  respectively 

(a)  The  data  were  generated  as  in  l.a  above  but  with  0=  .05, 
producing  a  s ignal-to-noise  ratio*  of  approximately  1100. 

Again,  various  combinations  of  '(  and  8  were  used  and  the  re¬ 
sults  are  presented  in  Table  D.4.  As  in  l.a,  the  best  choice 
of  parameters  was  again  y  =  .95,  6  -  .95.  This  is  not  sur¬ 
prising  as  the  signal-to-noise  ratio  is  high.  Note  the  poorer 
performance  of  the  filter  in  Case  14  where  8  was  reduced  to  .2. 
Since  the  noise  level  is  low,  a  high  rate  of  adaptation  is 
expected  to  be  optimal.  In  Figures  D.28  and  D.29,  the  actual 
states  are  plotted  over  the  45  time  periods  together  with  the 
one-step-ahead  predicted  states  for  Case  11.  Figures  D.30 

and  D.31  show  the  adaptation  of  the  elements  of  $  for  Case  11. 
Figures  D.32-D.35  are  similar  plots  for  Case  14.  Note  that 
in  Case  16  where  y=  .5  and  8=  .95,  the  system  goes  unstable. 

This  is  because  the  loop  gain  (3)  -  ■  i>  is  too  high  in  this  non¬ 
linear  system.  Cases  17  to  21  use  |^j  for  the  gain  matrix  K 

where  k  was  calculated  as  the  steady-state  Kalman  gain  using 
the  one-step-ahead  prediction  of  0  from  the  adaptive  filter. 

The  performance  of  the  filter  was  not  as  good  as  in  the 

K=[i]  cases.  Since  the  prediction  $  itself  depends  upon  the 

value  of  the  Kalman  gain  matrix  K,  the  filter  can  perform 

worse  than  with  K=[*j  if  the  $  prediction  is  not  accurate. 

(b)  Similar  data  to  (a)  were  generated  but  with  c=  .25  producing 
an  average  s ignai-to—ao ise  ratio  of  approximately  100.  Cases 
23  to  32  in  Table  D.5  cover  the  different  combinations  of  y 
and  8  used.  5est  results  were  obtained  with  v =  .95,  8=  .2. 

Since  the  signal-to-noise  ratio  here  is  lower  than  in  (a),  a 
lower  value  of  3  is  expected  to  be  optimal  so  that  the  rate  of 
adaptation  is  slowed  down.  In  Figures  D.36  and  3.37  the  actual 
states  and  the  one-step-ahead  predicted  states  are  plotted  for 
Case  25  (y  -  .95,  3=  .2)  and  Figures  3.38  and  3.39  show  the 
adaptation  of  the  elements  of  v. 

(c)  A  third  set  of  data  was  generated  as  in  fa)  and  (b)  but  with 
0=1.25  producing  an  average  signal-to-noise  ratio  of  approxi¬ 
mately  30.  Various  comb ir.ations  of  y  and  2  were  used  in  Cases 
34  to  38  in  Table  D.6  and  the  optimal  values  were  found  to  be 
y=  .95,  8  =  .05  in  Case  35.  Since  the  noise  level  is  higher 
here  than  in  (b) ,  a  lower  2  is  expected  to  be  optimal.  Figures 
D.40  to  D.43  show  the  actual  and  the  one-step-ahead  predicted 
states  and  the  adaptation  of  the  elements  of  5. 

--  ^ 

*SignaI -to-noise  ratio  was  computed  as  the  average  value  of  (x(i)  x(i)/tr  Q) 


Noise-free  data:  6=72°,  36°,  0°,  respectively 

45  data  points  were  generated  by  decreasing  9  every  15  steps  from 

72°  to  36°  to  0°,  using  x(0)  =  as  in  (1).  This  set  of  data  points 

was  used  to  show  the  poor  performance  of  the  filter  when  the  data 
have  little  dynamics  and  are  almost  static  with  9  =  0°  in  the  transi¬ 
tion  matrix,  when 


-1  2 


That  is. 


x1(K+l) 

x2(K+1) 


x2('<) 

-Xl(K)  +  2x2(K)  =  x2(K) 


Hence,  all  the  dynamics  in  the  data  are  suppressed  (see  Table  D.7). 
Figures  D.44  and  D.45  show  the  adaptation  of  f(2,l)  and  $(2,2).  In 
Case  40  it  is  not  surprising,  given  the  nature  of  the  data,  that 
identif iabil itv  is  very  bad;  in  fact  the  filter  identifies  the 

transition  matrix  approximately  which  also  gives: 

x1(K+l)  =  x2(K)  =x9(K+1).  Figures  D.46  and  D.47  show  the  actual  and 

one-step-ahead  predicted  states.  Note  that  toward  the  end  of  the 
simulation  where  9  =  0C,  the  filter  is  doing  a  good  job  of  predicting 
the  states  since  the  •!»  matrix  it  has  identified  produces  the  same 
nredicticn  of  the  static  states  as  the  actual  i  matrix  would. 
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Table  D.L  continued 


Table  D.4:  Adaptive  Filter  Performance  with  Noisy  Data 
SNR  =  1100;  0  =  50°,  40°,  30°;  x(0)  =  (1,  - 
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Table  D.4  concluded 
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Figure  D.2.  Case  (6).  Adaptation  of  0(1,31 
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Figure  D.5.  Case  (6),  Adaptation  of  (  2 , 2 ) 
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Figure  D.6.  Case  (7),  Adaptation  of  $(1.1). 
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Figure  D.7.  Case;  (7),  Adaptation  of  $(1,2). 
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Figure  D.14.  Case  (3).  i-i-l  Actual  x(l);  2-2-2  One-step-ahead 

predicted  x(l) 
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Figure  D.15.  Case  (3).  i~i  1~  Actual  x(2);  2-3-2  One-step-ahead 

predicted  n(2) 
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Figure  D.18.  Ca.-^c  (5).  d-V-t  Actual  x(l);  2-3-3  One-step-ahead 

prod io tod  x ( 1 ) 
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Figure  D.27.  Case  (7)  (y  -  .9 
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Figure  D. 30.  Case  (11)  (y=.95,  B=.95). 


Ill  One-step-ahead 
predicted  $(2,1) 
-  Actual  <J>(2,1) 


294 


40.0000 


tat 


-0.400 


*i 


r 


% 


-0.560 


-0.720 


-0.880 


-1.040 


-1.200 


1 

1 

1 

1 

1 

1 

1 

1 

t 

1 

1 

1 

1 

1 

1 

1 

» 

L 

! 

min 

L  J 

i  1111 

: 

r  -  1 

n 

l 

n 

l 

l 

n 

j 

1  11 

111  1) 

1 

LI 

J 

11 

1 

111111 

11 

L 1 1 1 

i 

.  . .  J 

0.0000  10.0000  20.0000  30.0000  40.0000  50.0000 


Figure  D.34.  Case  (14)  (y  =  .9,  S=  .2).  Ill  One-step-ahead 

predicted  $(2,1) 
-  Actual  $(2, 1) 


f 


r 

’i 

? 

/ 

> 


i 

v 

J 

t 

I 

\ 


\  ■ 

* 

) 

) 

f 


298 


299 


-0.300 


-0.460 


-0.620 


-0.780 


-0.940 


-1.100 

0.0000  10.0000  20.0000  30.0000  40.0000  50. 


+ - + - + - + 


J  i  !  1111 


:  l 

:  n 

:  in 

li 

in 

: mu  limn  i 

mi : 

i 

i 

li  : 

1 1 1 1 1 1  : 

i  i 

i  i 

i  t 

•  i 

I  I  •  I 

+ - + - + - + 


+ - + - + - + 


Figure  D. 42.  Case  (35)  (y=.95,  3 =.05).  1  1  1  One-step-ahead 

predicted  $(2,1). 
-  Actual  $(2,1) 
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Figure  D.A4.  Case  (AO)  (y=,9,  6=  •&)•  Ill  One-step-ahead 

predicted  <{>(2,1) 
-  Actual  4(2,1) 


F/«  */? 


AO-AOtO  -Iff  SCIENTIFIC  SvSTCMS  INC  CAMBRIDGE  HA 

RECURSIVE  FORECASTING  SrsTEN  FOR  PCRSON«jOO  NATCHatU) 

Stf  «0  D  E  SUSTAFSON,  R  K  HC"RA,  h  M  LCOSHAH  FJJAj5-7»-C-O0»O 
UNCLASSIFIED  AfHRL*TR*7**B)  NL 


SUPPLEMENTARY 


INFORMATION 


0>-Ao9*  V?? 


DEPARTMENT  OF  THE  AIR  FORCE 
AIR  FORCE  HUMAN  RESOURCES  LABORATORY  (AFSC) 
•ROOKS  AIR  FORCE  BASE.  TEXAS  7B235 


•inrro 

ATM  OF: 

IHUICT: 


TSR  ^ 

Removal  of  Export  Control  Statement 


<2L 


1 6  JAN  1981 


to:  Defense  Technical  Information  Center 
Attn:  DTIC/DDA  (Mrs  Crumbacker) 

Cameron  Station 
Alexandria  VA  22314 

1.  Please  remove  the  Export  Control  Statement  which  erroneously  appears  on 
the  Notice  Page  of  the  reports  listed  aMRlMMBBSBSMMR .  This  statement  is 
intended  for  application  to  Statement  B  reports  only. 

2.  Please  direct  any  auestions  to  AFHRL/TSR,  AUTOVON  240-3877. 

FOR  THE  COMMANDER 

WENDELL  L.  ANDERSON,  Lt  Col,  USAF  1  Atch 

Chief,  Technical  Services  Division  List  of  Reports 


Cy  to:  AFHRL/TSE 


f)&?C 


MR  FORCF  III  MW  RFSOl  RCFS  LXBOILMnKA 
Brook*  \ir  l  orn-  lta*e.  Texas  782t’> 

Irrata 


Number 

First 
\  til  hor 

Title 

AFIIHI. -TR-71.-87  (AD-A0.17  f.22) 

Jensen 

Willed  Serviees  \oealional  \|ililude  Itallerv 
Develo|nneul  (ASX  Ml  Form*  .">.  ti.  and  7) 

M  IIRI -TK-77-28  (AD-  Miff 

Hunter 

Aalidaliuit  ol  a  Psvelloinntur/Pereepliial  Test  liatlerv 

M  lllil  -  IR-77-.'i.l  (AD-AOHl  1211) 

Mathew* 

Sereening  Te*t  Itallerv  lor  Dental  i.ahoralorv 
SjH-eiali'l  lamrse:  Dev elo|iiuenl  and  Xalidation 

M  IIKI.-TR-77-7J  (\D-.\o:,l  <Mi2) 

Mathews 

Xnalysi*  \|ililude  Test  lol  Sehelion  of  Xirtlleu  lor 
the  Radio  taiiuiiiiinieation*  \nalv*i*  Speriali*! 
lanirse:  Development  and  Xalidation 

\l  IIRI.-TR-78-IO  (AD-Alk'JH  <»<>7) 

l)e\  any 

Supply  Rale  and  Kipiilihrium  Inventorv  of  Air  Fort  e 
Kulisted  Personnel:  V  Simultaneous  Model  of  the 
Xeres-ion  and  Retention  Market*  liu  orporating 
Foree  Level  l  ainstrainl- 

\l  IIRI  -TR-7H-71  (AD-AObb  (.'.<») 

l.eisey 

l Jiaraileristii*  of  Air  Foree  Veeession*:  Jantiaty 
PL75  to  June  D>77 

Al  IIKL-TR-78-82  (AD-AOb.'l  (>:><,) 

Mathew* 

IWiiliim  of  Reading  tirade  Lev  el*  of  Sort  iee  Appli- 
eants  from  Armed  Servile*  Aot-alional  Aptitude  Bat¬ 
tery  LXSVAB) 

AFHRI.-TR-7<>-2‘>  (AD-A078  127) 

Hendrix 

Pre-F.nlistmenl  I’erson-Joh  Mali  h  Svslem 

\l  IIRI  TR-7'»-8:i  (AD-Atl'HI  P>'» 

l.uslafsou 

Reeur-ive  Foret  asting  Sy  stem  lor  Person-Job  Mateli 

I >11.  in  norming  problem*  enrnuntered  with  ASA  \B  Form-  .”>.  (>.  and  7.  pereenlile  -niro  derived  from 
lln*-!-  lest  form*  art-  in  error  VI  bile  I !»*•  relative  ranking  of  individuals  In  their  poreenlile  stores  would  nil 
he  afleeled  In  the  norming  error*,  their  absolute  store  value*  would  he  diflerent.  Then*for»*.  desrriptive 
•  tan-lie*  re|>orled  iii  the  *uh)eet  leehuieal  rejKirt*  above  are  erroneous:  other  l\|ie-  ol  aiialy*e«  in  tin 
teporl  whieh  u*e  ASA  Ml  pereenlile  *eore*  should  he  interpreted  with  eaulion. 


\\\t  \  l.l  INN.  I'ei  hnieal  Direelor 
Maii|Hiwer  ami  Personnel  lhvi*ion 


